-- Logs begin at Tue 2021-11-23 03:11:25 UTC, end at Tue 2021-11-23 04:35:50 UTC. -- Nov 23 04:05:32.539052 dv-cinder-768458-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 04:05:32.548044 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 04:05:32 2021] *** Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: nodename: dv-cinder-768458-16-iscsi Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: machine: x86_64 Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: clock source: unix Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: pcre jit disabled Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: detected number of CPU cores: 4 Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: current working directory: / Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: detected binary path: /usr/bin/uwsgi-core Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: your processes number limit is 47680 Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: your memory page size is 4096 bytes Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: detected max file descriptor number: 2048 Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: lock engine: pthread robust mutexes Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: thunder lock: enabled Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 04:05:32.550164 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 04:05:32.595533 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: Python main interpreter initialized at 0x55a67f2ca9c0 Nov 23 04:05:32.595533 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: python threads support enabled Nov 23 04:05:32.595533 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: your server socket listen backlog is limited to 100 connections Nov 23 04:05:32.595533 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: your mercy for graceful operations on workers is 90 seconds Nov 23 04:05:32.595937 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 04:05:32.595937 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: *** Operational MODE: preforking *** Nov 23 04:05:32.596210 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: *** uWSGI is running in multiple interpreter mode *** Nov 23 04:05:32.596210 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: spawned uWSGI master process (pid: 102590) Nov 23 04:05:32.596410 dv-cinder-768458-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 04:05:32.600862 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: spawned uWSGI worker 1 (pid: 102591, cores: 1) Nov 23 04:05:32.600862 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: spawned uWSGI worker 2 (pid: 102592, cores: 1) Nov 23 04:05:32.600862 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 04:05:34.208166 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 04:05:34.208166 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: from cryptography.utils import int_from_bytes Nov 23 04:05:34.208827 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 04:05:34.208827 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: from cryptography.utils import int_from_bytes Nov 23 04:05:34.209169 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 04:05:34.209169 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: from cryptography.utils import int_from_bytes Nov 23 04:05:34.209650 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 04:05:34.209650 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: from cryptography.utils import int_from_bytes Nov 23 04:05:36.699692 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 04:05:36.700126 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 04:05:36.700429 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 04:05:36.700795 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 04:05:36.701050 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 04:05:36.701505 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.701833 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.702155 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.702259 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 04:05:36.702592 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.702667 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 04:05:36.702810 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.703017 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 04:05:36.703191 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.703411 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 04:05:36.703553 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.703660 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 04:05:36.703746 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.704046 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.704138 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.704309 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.704428 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.704624 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.704732 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.704946 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-16-iscsi {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.705057 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.705268 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.705392 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.705574 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.705698 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.705882 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.706018 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.706200 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.706309 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.706504 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.706627 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.706823 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.706938 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.707124 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.707227 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.707491 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-16-iscsi {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.707653 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.707820 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.708721 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.708875 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.709029 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.709152 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.709344 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.709460 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.709683 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.709793 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.710000 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.710147 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.710289 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.710430 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.710600 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.710858 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.711024 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.711177 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.711336 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.711517 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.711642 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.711837 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.711968 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-16-iscsi {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.712182 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.712316 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.712504 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.712634 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.712825 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.712938 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.713145 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.713310 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.713461 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.713620 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.713791 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.713968 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.714127 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.714263 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.714506 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-16-iscsi {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.714648 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.714830 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.714989 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.715136 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.715301 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.715482 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.715631 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.715813 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.715985 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.716125 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.716259 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.716419 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.716568 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.716729 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.716877 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.717118 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.717263 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.717433 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.717579 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.717740 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.717886 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.718030 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.718162 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.718294 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.718434 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.718568 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.718728 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.718867 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.719008 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.719188 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.719369 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.719535 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.719681 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.719824 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.719966 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.720115 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.720251 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.720382 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.720521 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.720653 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.720786 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.720929 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.721064 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.721227 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.721367 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.721538 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.721686 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.721845 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.721994 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.722235 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.722384 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.722528 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.722701 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.722839 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.722972 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.723106 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.723259 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.723421 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.723556 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.724266 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.724557 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.724707 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.724851 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.724997 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.725131 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.725272 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.725406 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.725594 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.725743 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.54 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.725966 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.54 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.726102 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.726237 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.726374 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.726508 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.726648 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.726823 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.726970 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.727133 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.727317 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.727464 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.727607 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.727786 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.727944 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.728084 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.728218 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.54 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.728388 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.728537 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.54 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.728698 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.728838 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.729016 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.729164 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.729349 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.729501 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.729655 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.729795 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.729937 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.730080 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.730220 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.730361 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.730501 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.730640 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.730780 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.730920 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.731086 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.731248 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.731419 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.731561 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.731727 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.731880 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.732022 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.732156 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.732319 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.732459 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.732676 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.732822 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.732991 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.733134 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.733299 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.733444 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.733617 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.733766 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.733932 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.734074 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.734247 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.734387 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.734554 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.734708 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.734853 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.734986 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.735160 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.735361 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.735496 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.735640 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.735785 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.735925 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.736092 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.736231 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.736398 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.736548 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.736703 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.736843 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.737012 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.737151 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.737318 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.737465 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.737624 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.737776 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.737943 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.738083 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.738248 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.738397 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.738537 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.738671 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.738856 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.738997 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.739163 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.739995 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.740137 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.740377 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.740556 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.740732 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.740873 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.741066 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.741215 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.741381 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.741529 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.741695 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.741842 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.741985 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.742118 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.742296 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.742437 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.742602 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.742748 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.742891 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.743026 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.743197 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.743375 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.743529 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.743681 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.743821 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.743993 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.744132 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.744265 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.744415 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.744557 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.744698 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.744838 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.745018 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.745159 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.745328 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.745475 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.745615 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.745765 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.745923 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.746063 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.746244 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.746401 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.746536 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.746669 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.746860 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.746998 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.747189 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.747367 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.747529 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.747668 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.747844 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.747984 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.748154 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.748295 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.748477 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.748615 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:05:36.748788 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.748928 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.749116 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.749262 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.749469 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.749614 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.749792 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.749944 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.750100 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.750238 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.750411 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.750550 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.750729 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.750876 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.751047 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.751186 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.751403 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.751545 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.751718 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.751867 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.752033 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.752179 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.752349 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.752499 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.752717 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.752868 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.753009 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.753143 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.753284 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.753418 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.753573 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.753723 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.753884 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.754024 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.754218 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.754367 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.754543 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.754693 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.755007 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.755170 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.755341 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.755475 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.755624 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.755758 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.755891 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.756024 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.756157 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.756297 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.756497 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.756640 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.756843 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.756984 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.757163 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.757314 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.757491 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.757632 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.757811 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.757958 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.758144 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.758283 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.758459 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.758617 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.758775 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.758915 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.759078 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.759270 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.759426 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.759561 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.759694 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.759834 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.759992 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.760140 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.760296 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.760443 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.760613 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.760754 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.760938 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.761087 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.761247 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.761388 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.761574 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.761721 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.761880 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.762032 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.762175 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.762315 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.762484 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.762631 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.762788 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.762937 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.763100 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.763273 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.763424 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.763560 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.763725 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.763866 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.764049 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.764189 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.764357 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.764507 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.764649 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.764784 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.764971 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.765111 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.765275 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.765420 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.765566 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.765706 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.765877 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.766024 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.766188 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.766330 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.766485 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.766618 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.766797 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.766938 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.767116 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.767290 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.767452 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.767594 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.767759 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.767899 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.768078 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.768232 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.768394 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.768551 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.768685 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.768825 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.769005 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.769154 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.769329 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.769468 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.769642 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.769780 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.769947 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.770089 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.770255 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.770412 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.770635 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.770774 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.770954 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.771095 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.771310 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.771462 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.771646 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.771786 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.771968 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.772109 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.772278 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.772424 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.772578 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.772719 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.772861 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.772994 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.773161 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.773302 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.773481 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.773619 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.773786 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.773934 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.774091 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.774237 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.774377 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.774534 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.774675 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.774815 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.774986 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.775126 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.775320 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.775472 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.775647 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.775786 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.775962 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.776103 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.776274 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.776451 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.776598 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.776733 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.776866 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.776999 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.777189 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.777340 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.777497 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.777638 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.777809 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.777949 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.778118 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.778259 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.778425 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.778566 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.778744 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.778885 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.779053 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.779194 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.779426 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.779566 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.779744 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.779891 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.780064 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.780205 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.780373 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.780522 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.780691 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.780832 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.781000 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.781147 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.781297 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.781439 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.781626 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.781773 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.781941 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.782081 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.782252 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.782404 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.782570 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.782719 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.782860 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.782994 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.783175 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.783340 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.783505 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.783656 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.783797 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.783932 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.784107 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.784246 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.784414 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.784628 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.784767 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.784901 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.785035 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.785175 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.785309 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.785450 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.785618 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.785759 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.785935 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.786076 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.787031 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.787184 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.787363 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.787505 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.787639 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.787771 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.787918 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.788052 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.788193 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.788333 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.788477 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.788643 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.788796 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.788957 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.789105 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.789251 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.789392 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.789568 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.789716 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.789856 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.790006 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.790171 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.790323 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.790476 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.790618 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.790756 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.790895 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.791057 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.791265 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.791430 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.791572 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.791718 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.791865 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.792005 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.792144 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.792296 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.792437 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.792577 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.792716 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.792856 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.793017 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.793166 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.793307 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.793447 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.793587 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.793732 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.793881 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.794022 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.794161 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.794301 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.794441 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.794610 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.794774 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.794926 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.795066 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.795316 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.795480 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.795622 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.795771 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.795911 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.796050 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.796222 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.796369 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.796510 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.796658 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.796799 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.796954 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.797094 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.797234 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.797425 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.797582 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.797723 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.797870 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.798010 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.798149 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.798318 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.798471 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.798637 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.798784 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.798934 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.799081 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.799277 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.799426 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.799566 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.799708 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.799847 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.799996 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.800146 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.800287 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.800448 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.800595 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.800746 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.800892 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.801044 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.801186 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.801353 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.801507 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.801649 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.801852 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.802029 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.802183 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.802405 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.802551 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.802732 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.802898 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.803039 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.803177 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.803352 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.803493 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.803642 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.803790 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.803954 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.804102 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.804269 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.804416 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.804844 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.805100 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.805258 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.805433 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.805581 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.805751 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.805908 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.806057 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.806197 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.806378 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.806526 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.806694 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.806848 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.807016 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.807173 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.807363 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.807617 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.807765 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.807952 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.808105 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.808246 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.808386 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.808550 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.808704 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.808851 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.808995 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.809143 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.809294 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.809434 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.809622 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.809737 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.809848 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.810017 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.810168 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.810325 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.810502 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.810668 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.810770 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.811001 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.811088 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.811373 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.811482 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.811682 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.811799 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.811995 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.812082 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.812298 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.812383 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.812605 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.812698 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.812906 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.812991 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.813213 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.813312 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.813531 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.813640 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.813822 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.813920 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.814121 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.814388 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.814490 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.814584 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.814747 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.814903 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.815047 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.815198 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.815393 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.815546 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.815695 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.815838 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.815999 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.816148 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.816297 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.816439 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.816587 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.816729 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.816900 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.817049 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.817208 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.817974 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.818148 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.818300 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.818449 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.818593 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.818744 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.818895 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.819036 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.819187 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.819364 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.819583 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.819730 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.819914 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.820057 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.820198 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.820339 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.820487 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.820634 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.820775 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.820925 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.821068 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.821208 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.821357 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.821510 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.821663 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.821804 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.821952 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.822099 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.822248 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.822387 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.822527 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.822667 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.822815 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.822968 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.823116 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.823328 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.823477 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.823629 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.823771 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.823927 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.824077 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.824223 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.824364 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.824516 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.824664 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.824818 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.824961 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.825113 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.825255 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.825396 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.825547 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.825702 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.825853 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.825995 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.826136 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.826284 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.826497 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.826640 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.826780 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.826928 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.827070 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.827257 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.827419 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.827573 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.827714 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.827855 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.827997 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.828138 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.828287 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.828429 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.828570 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.828710 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.828851 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.828993 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.829142 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.829283 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.829434 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.829575 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.829722 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.829871 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.830013 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.830155 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.830295 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.830435 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.830575 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.830722 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.830864 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.831004 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.831155 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.831325 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.831477 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.831626 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.831775 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.831916 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.832057 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.832199 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.832339 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.832493 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.832643 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.832795 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.832937 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.833172 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.833326 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.833467 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.833673 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.833819 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.833959 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.834099 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.834257 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.834400 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.834541 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.834681 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.834821 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.834967 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.835132 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.835303 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.835449 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.835589 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.835729 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.835869 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.836020 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.836162 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.836308 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.836449 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.836597 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.836737 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.836890 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.837042 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.837184 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.837324 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.837465 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.837656 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.837806 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.837953 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.838102 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.838243 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.838394 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.838544 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.838693 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.838834 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.838985 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.839148 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.839343 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.839501 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.839645 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.839785 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.839899 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.840104 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.840206 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.840405 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.840495 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.840711 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.840799 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.841016 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.841112 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.841319 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.841419 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.841627 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.841715 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.841942 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.842039 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.842259 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.842353 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.842586 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.842675 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.842901 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.842995 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.843237 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.843326 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.843543 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.843626 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.843847 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.843945 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.844158 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.844257 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.844464 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.844549 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.844768 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.844856 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.845078 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.845183 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.845381 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.845474 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.845683 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.845771 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.845988 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.846084 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.846290 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.846378 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.846598 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.846685 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.846900 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.846986 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.847230 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.847330 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.847548 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.847636 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.847858 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.847944 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.848187 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.848282 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.848499 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.848593 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.849328 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.849420 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.849697 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.849794 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.850014 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.850130 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.850321 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.850418 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.850629 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.850722 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.851034 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.851129 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.851371 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.851459 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.851683 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.851782 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.851987 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.852073 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.852290 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.852385 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.852601 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.852700 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.852920 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.853004 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.853222 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.853316 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.853525 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.853621 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.853826 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.853942 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.854165 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.854260 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.854453 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.854565 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.854772 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.854884 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.855185 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.855299 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.855515 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.855604 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.855820 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.855916 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.856219 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.856313 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.856526 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.856610 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.856833 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.856916 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.857145 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.857263 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.857465 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.857557 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.857774 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.857858 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.858102 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.858198 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.858450 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.858536 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.858760 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.858845 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.859081 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.859175 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.859428 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.859562 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.859739 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.859879 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.860058 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.860198 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.860361 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.860525 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.860680 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.860851 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.861000 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.861179 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.861316 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.861490 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.861634 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.861812 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.862046 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.862133 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.862366 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.862462 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.862676 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.862768 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.862994 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.863081 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.863347 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.863437 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.863655 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.863758 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.863958 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.864068 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.864862 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.864958 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.865204 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.865373 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.865516 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.865613 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.865865 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.865958 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.866170 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.866256 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.866482 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.866647 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.866793 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.866880 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.867100 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.867184 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.867426 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.867526 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.867729 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.867815 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.868049 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.868134 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.868352 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.868454 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.868670 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.868758 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.868981 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.869066 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.869300 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.869387 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.869620 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.869712 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.869921 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.870006 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.870238 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.870324 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.870544 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.870636 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.870849 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.870935 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.871151 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.871266 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.871481 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.871566 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.871816 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.871900 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.872118 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.872211 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.872436 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.872522 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.872762 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.872859 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.873073 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.873160 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.873403 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.873495 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.873719 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.873818 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.874033 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.874126 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.874344 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.874435 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.874657 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.874754 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.874998 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.875085 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.875323 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.875420 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.875629 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.875729 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.875936 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.876029 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.876240 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.876334 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.876542 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.876635 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.876844 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.876929 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.877149 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.877241 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.877449 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.877535 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.877749 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.877833 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.878048 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.878163 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.878367 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.878475 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.878672 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.878775 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.878990 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.879077 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.879320 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.879411 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.879626 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.879711 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.880018 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.880126 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.880333 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.880449 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.880643 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.880870 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.880956 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.881184 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.881289 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.881516 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.881602 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.881832 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.881925 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.882154 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.882240 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.882467 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.882558 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.882777 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.882862 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.883083 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.883169 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.883429 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.883515 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.883747 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.883843 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.884061 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.884148 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.884375 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.884460 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.884695 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.884834 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.885003 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.885102 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.885316 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.885402 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.885625 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.885720 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.885937 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.886032 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.886249 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.886338 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.886562 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.886656 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.886878 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.887075 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.887197 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.887428 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.887531 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.887741 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.887848 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.888051 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.888167 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.888359 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.888481 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.888672 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.888798 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.888982 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.889117 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.889290 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.889436 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.889597 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.889904 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.889989 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.890211 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.890298 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.890536 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.890622 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.890857 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.890943 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.891181 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.891305 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.891526 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.891611 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.891838 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.891923 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.892150 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.892245 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.892462 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.892554 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.892769 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.892854 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.893081 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.893167 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.893417 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.893502 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.893721 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.893807 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.894035 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.894122 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.894349 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.894441 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.894663 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.894748 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.894975 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.895062 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.895315 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.895405 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.895688 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897172 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897378 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897378 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897520 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897590 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897656 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897730 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897797 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897863 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897863 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.897978 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.898050 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.898117 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.898189 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.898256 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.898484 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.898581 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.898793 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.898871 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.899107 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.899236 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.899504 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.899646 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.899826 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.899958 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.900144 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.900290 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.900463 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.900615 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.900782 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.900951 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.901116 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.901267 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.901457 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.901584 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.901784 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.901912 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.902107 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.902216 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.902426 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.902521 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.902748 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.902834 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.903109 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.903296 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.903439 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.903619 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.903760 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.903957 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.904070 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.904287 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.904382 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.904616 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.904702 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.904940 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.905020 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.905263 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.905489 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.905634 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.905837 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.905942 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.906150 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.906243 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.906473 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.906560 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.906792 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.906877 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.907101 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.907193 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.907429 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.907516 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.907752 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.907838 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.908057 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.908151 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.908363 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.908455 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.908676 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.908762 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.908986 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.909215 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.909312 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.909570 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.909656 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.909877 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.909962 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.910183 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.910273 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.910484 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.910570 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.910791 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.910875 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.911624 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.911722 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.911965 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.912083 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.912332 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.912432 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.912564 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.912714 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.912870 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.913038 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.913183 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.913377 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.913491 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.913667 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.913776 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.913981 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.914067 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.914301 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.914389 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.914619 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.914705 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.914931 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.915018 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.915268 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.915359 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.915571 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.915663 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.915885 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.916008 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.916188 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.916297 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.916495 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.916581 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.916796 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.916890 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.917113 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.917198 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.917414 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.917499 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.917717 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.917811 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.918026 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.918111 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.918333 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.918417 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.918648 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.918742 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.918956 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.919057 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.919286 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.919392 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.919598 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.919685 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.919918 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.920003 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.920232 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.920520 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.920618 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.920844 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.920929 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.921172 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.921265 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.921486 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.921580 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.921795 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.921882 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.922116 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.922201 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.922437 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.922530 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.922754 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.922839 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.923073 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.923169 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.923406 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.923502 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.923716 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.923802 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.924026 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.924111 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.924334 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.924593 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.924681 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.924938 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.925030 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.925245 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.925339 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.925552 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.925634 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.925861 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.925955 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.926175 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.926271 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.926512 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.926599 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.926903 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.927186 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.927321 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.927405 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.927614 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.927701 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.927934 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.928028 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.928247 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.928335 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.928557 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.928643 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.928866 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.928962 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.929177 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.929264 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.929496 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.929850 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.930087 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.930181 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.930440 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.930532 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.930701 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.930788 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.931049 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.931150 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.931400 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.931489 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.931728 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.931822 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.932052 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.932147 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.932358 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.932451 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.932678 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.932765 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.932991 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.933077 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.933299 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.933382 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.933611 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.933697 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.933917 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.934002 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.934244 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.934337 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.934558 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.934643 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.934871 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.934959 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.935201 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.935324 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.935534 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.935632 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.935919 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.936014 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.936228 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.936314 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.936538 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.936638 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.936867 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.936955 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.937190 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.937271 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.937502 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.937599 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.937822 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.937909 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.938134 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.938218 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.938452 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.938537 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.938757 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.938843 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.939077 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.939174 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.939423 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.939511 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.939735 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.939821 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.940043 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.940128 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.940353 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.940439 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.940666 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.940749 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.940976 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.941061 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.941286 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.941373 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.941600 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.941693 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.941906 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.941999 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.942215 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.942307 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.943085 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.943183 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.943435 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.943537 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.943742 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.943830 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.944065 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.944158 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.944383 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.944483 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.944700 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.944786 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.945013 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.945099 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.945323 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.945410 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.945648 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.945733 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.945959 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.946044 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.946274 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.946368 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.946583 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.946677 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.946892 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.946977 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.947234 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.947325 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.947540 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.947626 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.947863 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.947960 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.948184 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.948282 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.948505 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.948590 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.948822 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.948915 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.949139 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.949223 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.949455 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.949541 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.949788 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.949882 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.950107 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.950199 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.950420 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.950512 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.950731 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.950825 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.951032 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.951125 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.951407 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 04:05:36.951496 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.951757 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.952091 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.952423 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.952760 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.953090 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.953440 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.953759 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.954107 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.954442 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.954762 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.955081 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.955416 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:05:36.955666 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 04:05:36.975417 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG oslo_db.sqlalchemy.engines [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:05:36.978847 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_db.sqlalchemy.engines [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:05:37.044007 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.context [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f047aa68-6146-4dc8-a7df-79b907216663(cell1) {{(pid=102591) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 04:05:37.045984 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.context [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f047aa68-6146-4dc8-a7df-79b907216663(cell1) {{(pid=102592) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 04:05:37.048454 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG oslo_concurrency.lockutils [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:05:37.050009 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG oslo_concurrency.lockutils [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:05:37.050196 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:05:37.050815 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG oslo_concurrency.lockutils [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:05:37.052473 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:05:37.053182 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:05:37.053678 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG oslo_concurrency.lockutils [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:05:37.055427 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:05:37.064272 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG oslo_db.sqlalchemy.engines [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:05:37.066762 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG oslo_db.sqlalchemy.engines [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:05:37.069261 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_db.sqlalchemy.engines [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:05:37.071781 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_db.sqlalchemy.engines [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:05:37.325673 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG oslo_db.sqlalchemy.engines [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:05:37.330230 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_db.sqlalchemy.engines [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:05:37.732019 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: WARNING keystonemiddleware.auth_token [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 04:05:37.738587 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: WARNING keystonemiddleware.auth_token [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 04:05:37.756918 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: WARNING keystonemiddleware.auth_token [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 04:05:37.763421 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: WARNING keystonemiddleware.auth_token [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 04:05:37.963514 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: WARNING keystonemiddleware.auth_token [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 04:05:37.968565 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: WARNING keystonemiddleware.auth_token [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 04:05:37.974060 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a67f2ca9c0 pid: 102591 (default app) Nov 23 04:05:37.976201 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:05:37.977363 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] 10.222.0.54 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001800 Nov 23 04:05:37.977780 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 1/1] 10.222.0.54 () {50 vars in 788 bytes} [Tue Nov 23 04:05:37 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:05:37.987373 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: WARNING keystonemiddleware.auth_token [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 04:05:37.993095 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: WARNING keystonemiddleware.auth_token [None req-cdb1a53f-2bca-4e1e-8129-e2686d8bf08b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 04:05:37.998403 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a67f2ca9c0 pid: 102592 (default app) Nov 23 04:07:01.692001 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:01.693018 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Nov 23 04:07:01.693446 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 2/2] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:02.245701 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-44ea4a65-c291-482e-a777-1804f94eb9be admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:02.275480 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-44ea4a65-c291-482e-a777-1804f94eb9be admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.574855 Nov 23 04:07:02.276339 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 1/3] 10.222.0.54 () {60 vars in 1291 bytes} [Tue Nov 23 04:07:01 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:07:04.602054 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:04.603074 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-02eaf734-6a61-4cc1-b69f-c4fe4f54532d None None] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Nov 23 04:07:04.603526 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 3/4] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:04.662723 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-d83028a4-0605-4bb4-953e-719dd9ce2f32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "swap": 0}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:04.684481 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:07:04.684481 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: warnings.warn(msg) Nov 23 04:07:04.805245 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-d83028a4-0605-4bb4-953e-719dd9ce2f32 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.195383 Nov 23 04:07:04.809597 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 2/5] 10.222.0.54 () {64 vars in 1282 bytes} [Tue Nov 23 04:07:04 2021] POST /compute/v2.1/flavors => generated 407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:07:05.147659 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-c3029154-2b4d-40bf-9565-ac4354d79acd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:05.149989 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:07:05.149989 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: warnings.warn(msg) Nov 23 04:07:05.265241 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-c3029154-2b4d-40bf-9565-ac4354d79acd admin admin] 10.222.0.54 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.450544 Nov 23 04:07:05.266177 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 4/6] 10.222.0.54 () {64 vars in 1335 bytes} [Tue Nov 23 04:07:04 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:07:07.594227 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-d83028a4-0605-4bb4-953e-719dd9ce2f32 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:07.595807 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-d83028a4-0605-4bb4-953e-719dd9ce2f32 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Nov 23 04:07:07.596213 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 3/7] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:07.709646 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-c66c25f3-fc9e-4700-b4fd-9117d413dc9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "disk": 5, "vcpus": 1}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:07.727553 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:07:07.727553 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: warnings.warn(msg) Nov 23 04:07:07.853879 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-c66c25f3-fc9e-4700-b4fd-9117d413dc9d admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.250992 Nov 23 04:07:07.854463 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 5/8] 10.222.0.54 () {64 vars in 1282 bytes} [Tue Nov 23 04:07:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:07:07.867905 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-ffc6ad57-c8d1-4548-96ee-1de23bd85679 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:07.869383 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:07:07.869383 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: warnings.warn(msg) Nov 23 04:07:07.959852 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-ffc6ad57-c8d1-4548-96ee-1de23bd85679 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095576 Nov 23 04:07:07.960460 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 4/9] 10.222.0.54 () {64 vars in 1335 bytes} [Tue Nov 23 04:07:07 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:07:10.309669 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-c66c25f3-fc9e-4700-b4fd-9117d413dc9d admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:10.310737 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-c66c25f3-fc9e-4700-b4fd-9117d413dc9d admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Nov 23 04:07:10.311162 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 6/10] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:10.375314 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-a94311a3-b039-43b4-8eea-9c06f0f1587e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "ram": 1024}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:10.435504 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-a94311a3-b039-43b4-8eea-9c06f0f1587e admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.117792 Nov 23 04:07:10.436069 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 5/11] 10.222.0.54 () {64 vars in 1282 bytes} [Tue Nov 23 04:07:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:07:10.448756 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-b4ccbf1f-ba4a-46af-a274-2dbd225c0585 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:10.557207 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-b4ccbf1f-ba4a-46af-a274-2dbd225c0585 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108994 Nov 23 04:07:10.560698 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 7/12] 10.222.0.54 () {64 vars in 1335 bytes} [Tue Nov 23 04:07:10 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:07:12.911321 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-a94311a3-b039-43b4-8eea-9c06f0f1587e admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:12.912396 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-a94311a3-b039-43b4-8eea-9c06f0f1587e admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Nov 23 04:07:12.912807 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 6/13] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:12.973178 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-82bea172-41f0-49e6-82de-d62abf537a7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:13.061571 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-82bea172-41f0-49e6-82de-d62abf537a7d admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142363 Nov 23 04:07:13.062358 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 8/14] 10.222.0.54 () {64 vars in 1282 bytes} [Tue Nov 23 04:07:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:07:13.075231 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-579a7d15-864e-4440-b02a-15f9fe913a34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:13.165981 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-579a7d15-864e-4440-b02a-15f9fe913a34 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094304 Nov 23 04:07:13.166632 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 7/15] 10.222.0.54 () {64 vars in 1335 bytes} [Tue Nov 23 04:07:13 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:07:15.603428 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-82bea172-41f0-49e6-82de-d62abf537a7d admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:15.604304 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-82bea172-41f0-49e6-82de-d62abf537a7d admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Nov 23 04:07:15.611063 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 9/16] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:15 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:15.676490 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-9cce7f92-d6af-4089-8c4b-bba65c5f6285 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "vcpus": 4}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:15.794263 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-9cce7f92-d6af-4089-8c4b-bba65c5f6285 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.181696 Nov 23 04:07:15.794759 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 8/17] 10.222.0.54 () {64 vars in 1282 bytes} [Tue Nov 23 04:07:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:07:15.807643 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-74d1af96-87a1-4338-8655-1bba24173004 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:15.890152 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-74d1af96-87a1-4338-8655-1bba24173004 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085953 Nov 23 04:07:15.890884 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 10/18] 10.222.0.54 () {64 vars in 1335 bytes} [Tue Nov 23 04:07:15 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:07:18.219820 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-9cce7f92-d6af-4089-8c4b-bba65c5f6285 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:18.221176 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-9cce7f92-d6af-4089-8c4b-bba65c5f6285 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002492 Nov 23 04:07:18.221571 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 9/19] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:18.281332 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-76051529-339d-4190-9943-f7333c95dc10 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:18.307138 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-76051529-339d-4190-9943-f7333c95dc10 admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078497 Nov 23 04:07:18.307709 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 11/20] 10.222.0.54 () {60 vars in 1291 bytes} [Tue Nov 23 04:07:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:07:20.601439 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-9cce7f92-d6af-4089-8c4b-bba65c5f6285 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:20.602446 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-9cce7f92-d6af-4089-8c4b-bba65c5f6285 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 23 04:07:20.602848 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 10/21] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:20.673216 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-21b88569-7b19-4ad7-b43e-ecb532a7d087 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:20.732082 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-21b88569-7b19-4ad7-b43e-ecb532a7d087 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.123013 Nov 23 04:07:20.732687 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 12/22] 10.222.0.54 () {64 vars in 1282 bytes} [Tue Nov 23 04:07:20 2021] POST /compute/v2.1/flavors => generated 402 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:07:20.745031 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-91b79803-2183-4c2a-a7a6-39baa4018b9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:20.862511 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-91b79803-2183-4c2a-a7a6-39baa4018b9e admin admin] 10.222.0.54 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120992 Nov 23 04:07:20.863458 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 11/23] 10.222.0.54 () {64 vars in 1332 bytes} [Tue Nov 23 04:07:20 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:07:23.392932 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-21b88569-7b19-4ad7-b43e-ecb532a7d087 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:23.393949 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-21b88569-7b19-4ad7-b43e-ecb532a7d087 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Nov 23 04:07:23.394353 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 13/24] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:23.454617 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-4db4c893-3ae1-4e1f-a537-d54e27f7e8ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "name": "m1.small", "swap": 0, "disk": 20}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:23.527741 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-4db4c893-3ae1-4e1f-a537-d54e27f7e8ac admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.126985 Nov 23 04:07:23.528478 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 12/25] 10.222.0.54 () {64 vars in 1282 bytes} [Tue Nov 23 04:07:23 2021] POST /compute/v2.1/flavors => generated 405 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:07:23.540611 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-59db5517-c875-49df-8455-df6c217d5032 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:23.627640 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-59db5517-c875-49df-8455-df6c217d5032 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090430 Nov 23 04:07:23.628093 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 14/26] 10.222.0.54 () {64 vars in 1332 bytes} [Tue Nov 23 04:07:23 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:07:25.902939 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-4db4c893-3ae1-4e1f-a537-d54e27f7e8ac admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:25.904116 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-4db4c893-3ae1-4e1f-a537-d54e27f7e8ac admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Nov 23 04:07:25.904650 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 13/27] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:25.965462 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-7b93a3c6-cebc-4dc2-a951-636898621d6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:26.045743 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-7b93a3c6-cebc-4dc2-a951-636898621d6f admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.133868 Nov 23 04:07:26.046474 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 15/28] 10.222.0.54 () {64 vars in 1282 bytes} [Tue Nov 23 04:07:25 2021] POST /compute/v2.1/flavors => generated 406 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:07:26.059387 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-93a3dae0-77ff-42fb-9346-490b89b1f44d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:26.141466 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-93a3dae0-77ff-42fb-9346-490b89b1f44d admin admin] 10.222.0.54 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085638 Nov 23 04:07:26.142164 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 14/29] 10.222.0.54 () {64 vars in 1332 bytes} [Tue Nov 23 04:07:26 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:07:28.448007 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-7b93a3c6-cebc-4dc2-a951-636898621d6f admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:28.449024 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-7b93a3c6-cebc-4dc2-a951-636898621d6f admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 23 04:07:28.449434 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 16/30] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:07:28.513024 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-c4f96451-bf13-4fca-aa91-5ff81b821d57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:28.605099 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-c4f96451-bf13-4fca-aa91-5ff81b821d57 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.148797 Nov 23 04:07:28.605841 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 15/31] 10.222.0.54 () {64 vars in 1282 bytes} [Tue Nov 23 04:07:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:07:28.618401 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-a8578da7-88c1-4a57-bf1c-a4950fb1c130 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:28.701273 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-a8578da7-88c1-4a57-bf1c-a4950fb1c130 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086505 Nov 23 04:07:28.702201 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 17/32] 10.222.0.54 () {64 vars in 1332 bytes} [Tue Nov 23 04:07:28 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:07:31.216000 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-c4f96451-bf13-4fca-aa91-5ff81b821d57 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:31.217826 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-c4f96451-bf13-4fca-aa91-5ff81b821d57 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002293 Nov 23 04:07:31.219690 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 16/33] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:31 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:31.294458 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-d510d768-ca91-4623-ae80-675944cb3cf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:31.423504 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-d510d768-ca91-4623-ae80-675944cb3cf7 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.198205 Nov 23 04:07:31.424417 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 18/34] 10.222.0.54 () {64 vars in 1282 bytes} [Tue Nov 23 04:07:31 2021] POST /compute/v2.1/flavors => generated 408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:07:31.437061 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-982f6c87-a95b-4289-a9ac-de8a9e534443 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:07:31.628331 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-982f6c87-a95b-4289-a9ac-de8a9e534443 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.194942 Nov 23 04:07:31.629588 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 17/35] 10.222.0.54 () {64 vars in 1332 bytes} [Tue Nov 23 04:07:31 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:07:54.850529 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-d510d768-ca91-4623-ae80-675944cb3cf7 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:54.851580 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-d510d768-ca91-4623-ae80-675944cb3cf7 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 23 04:07:54.851985 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 19/36] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:07:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:54.909550 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-51ad8128-aad3-4026-8a2b-8475a5bd2070 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:54.926312 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-51ad8128-aad3-4026-8a2b-8475a5bd2070 admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067607 Nov 23 04:07:54.926843 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 18/37] 10.222.0.54 () {60 vars in 1291 bytes} [Tue Nov 23 04:07:54 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:07:56.406393 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-d510d768-ca91-4623-ae80-675944cb3cf7 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:56.407417 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-d510d768-ca91-4623-ae80-675944cb3cf7 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 23 04:07:56.407820 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 20/38] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:07:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:56.597259 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-22f0855f-612d-4fc8-bac4-ef8ea29861a6 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:56.602659 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.wsgi [None req-22f0855f-612d-4fc8-bac4-ef8ea29861a6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 04:07:56.603248 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-22f0855f-612d-4fc8-bac4-ef8ea29861a6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:07:56.604046 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-22f0855f-612d-4fc8-bac4-ef8ea29861a6 admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057241 Nov 23 04:07:56.604553 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 19/39] 10.222.0.54 () {60 vars in 1190 bytes} [Tue Nov 23 04:07:56 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:56.614893 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-a28b051f-94a7-4d88-951b-a8f720f6b3ee admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:56.634647 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-a28b051f-94a7-4d88-951b-a8f720f6b3ee admin admin] 10.222.0.54 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023323 Nov 23 04:07:56.635174 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 21/40] 10.222.0.54 () {60 vars in 1210 bytes} [Tue Nov 23 04:07:56 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:07:56.645109 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-df49c06f-7f8c-4c7c-b53e-bb09c8b915ad admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:56.666285 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-df49c06f-7f8c-4c7c-b53e-bb09c8b915ad admin admin] 10.222.0.54 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024525 Nov 23 04:07:56.666836 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 20/41] 10.222.0.54 () {60 vars in 1210 bytes} [Tue Nov 23 04:07:56 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:07:56.677786 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-da00f26f-5220-4c79-a77f-6000514ab49a admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:56.684012 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.wsgi [None req-da00f26f-5220-4c79-a77f-6000514ab49a admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 23 04:07:56.684588 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-da00f26f-5220-4c79-a77f-6000514ab49a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:07:56.685392 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-da00f26f-5220-4c79-a77f-6000514ab49a admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011456 Nov 23 04:07:56.685915 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 22/42] 10.222.0.54 () {60 vars in 1190 bytes} [Tue Nov 23 04:07:56 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:58.064807 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-df49c06f-7f8c-4c7c-b53e-bb09c8b915ad admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:58.065841 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-df49c06f-7f8c-4c7c-b53e-bb09c8b915ad admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 23 04:07:58.066236 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 21/43] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:07:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:58.257961 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-80d8338b-9e2b-4ab5-b345-a564e8ab4816 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:58.263922 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.wsgi [None req-80d8338b-9e2b-4ab5-b345-a564e8ab4816 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 04:07:58.265042 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-80d8338b-9e2b-4ab5-b345-a564e8ab4816 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:07:58.265903 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-80d8338b-9e2b-4ab5-b345-a564e8ab4816 admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058822 Nov 23 04:07:58.266427 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 23/44] 10.222.0.54 () {60 vars in 1190 bytes} [Tue Nov 23 04:07:58 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:58.276183 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-bd7e63ec-a916-48a5-8b25-ecf1ded348bc admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:58.289864 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-bd7e63ec-a916-48a5-8b25-ecf1ded348bc admin admin] 10.222.0.54 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017335 Nov 23 04:07:58.290382 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 22/45] 10.222.0.54 () {60 vars in 1210 bytes} [Tue Nov 23 04:07:58 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:07:58.300244 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-08c5ad98-ce2c-42d6-81aa-9dc3d0a0bfcf admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:58.313678 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-08c5ad98-ce2c-42d6-81aa-9dc3d0a0bfcf admin admin] 10.222.0.54 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016906 Nov 23 04:07:58.314200 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 24/46] 10.222.0.54 () {60 vars in 1210 bytes} [Tue Nov 23 04:07:58 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:07:58.323788 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-59f5848f-c718-4eac-8cad-34188d9f7bdd admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:58.329616 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.wsgi [None req-59f5848f-c718-4eac-8cad-34188d9f7bdd admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 23 04:07:58.330185 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-59f5848f-c718-4eac-8cad-34188d9f7bdd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:07:58.330978 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-59f5848f-c718-4eac-8cad-34188d9f7bdd admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010725 Nov 23 04:07:58.331511 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 23/47] 10.222.0.54 () {60 vars in 1190 bytes} [Tue Nov 23 04:07:58 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 23 04:07:59.700053 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-08c5ad98-ce2c-42d6-81aa-9dc3d0a0bfcf admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:59.700688 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-08c5ad98-ce2c-42d6-81aa-9dc3d0a0bfcf admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Nov 23 04:07:59.701160 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 25/48] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:07:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:07:59.888840 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-50fcbec9-1494-4be0-a5ab-900a05c2383b admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:59.894129 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.wsgi [None req-50fcbec9-1494-4be0-a5ab-900a05c2383b admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 04:07:59.894690 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-50fcbec9-1494-4be0-a5ab-900a05c2383b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:07:59.895500 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-50fcbec9-1494-4be0-a5ab-900a05c2383b admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057270 Nov 23 04:07:59.896003 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 24/49] 10.222.0.54 () {60 vars in 1193 bytes} [Tue Nov 23 04:07:59 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 23 04:07:59.905776 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-5cb6b52b-fcd5-4d7e-9117-4ea144278f11 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:59.918947 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-5cb6b52b-fcd5-4d7e-9117-4ea144278f11 admin admin] 10.222.0.54 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016697 Nov 23 04:07:59.919443 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 26/50] 10.222.0.54 () {60 vars in 1210 bytes} [Tue Nov 23 04:07:59 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:07:59.930740 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:59.944183 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] 10.222.0.54 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017298 Nov 23 04:07:59.944714 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 25/51] 10.222.0.54 () {60 vars in 1210 bytes} [Tue Nov 23 04:07:59 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:07:59.954214 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-46acedfa-dda9-48f7-8927-9e2bbacf9c1f admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:07:59.959318 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.wsgi [None req-46acedfa-dda9-48f7-8927-9e2bbacf9c1f admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 23 04:07:59.959874 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-46acedfa-dda9-48f7-8927-9e2bbacf9c1f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:07:59.960634 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-46acedfa-dda9-48f7-8927-9e2bbacf9c1f admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009971 Nov 23 04:07:59.961126 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 27/52] 10.222.0.54 () {60 vars in 1193 bytes} [Tue Nov 23 04:07:59 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 23 04:08:01.391724 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:01.392725 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Nov 23 04:08:01.393123 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 26/53] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:08:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:08:01.582478 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-fff3d285-43b6-406c-a9af-738eb1ef8783 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:08:01.661594 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-fff3d285-43b6-406c-a9af-738eb1ef8783 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.129041 Nov 23 04:08:01.662065 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 28/54] 10.222.0.54 () {64 vars in 1235 bytes} [Tue Nov 23 04:08:01 2021] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:08:03.057100 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:03.058101 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 23 04:08:03.058499 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 27/55] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:08:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:08:03.249158 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-8bdc3979-7a40-4c8e-901f-d2eb10be974f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:08:03.324614 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-8bdc3979-7a40-4c8e-901f-d2eb10be974f admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.127679 Nov 23 04:08:03.325173 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 29/56] 10.222.0.54 () {64 vars in 1235 bytes} [Tue Nov 23 04:08:03 2021] POST /compute/v2.1/flavors => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:08:04.721118 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:04.722149 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 23 04:08:04.722545 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 28/57] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:08:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:08:04.916206 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-747f7560-efb4-4e6b-8015-eaa818ec3044 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:08:04.998132 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-747f7560-efb4-4e6b-8015-eaa818ec3044 admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.134478 Nov 23 04:08:04.999574 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 30/58] 10.222.0.54 () {64 vars in 1235 bytes} [Tue Nov 23 04:08:04 2021] POST /compute/v2.1/flavors => generated 407 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:08:06.368841 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:06.369846 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Nov 23 04:08:06.370247 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 29/59] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:08:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:08:06.564284 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-c5bbd394-8d2c-405e-b581-3f5e2f47e65d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:08:06.656250 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-c5bbd394-8d2c-405e-b581-3f5e2f47e65d admin admin] 10.222.0.54 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.143954 Nov 23 04:08:06.656731 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 31/60] 10.222.0.54 () {64 vars in 1235 bytes} [Tue Nov 23 04:08:06 2021] POST /compute/v2.1/flavors => generated 409 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:08:08.027353 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:08.028365 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Nov 23 04:08:08.028762 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 30/61] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:08:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:08:08.233128 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-e5fce88c-fd7a-4b26-b837-4d0914c634d6 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:08.252062 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-e5fce88c-fd7a-4b26-b837-4d0914c634d6 admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069931 Nov 23 04:08:08.252534 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 32/62] 10.222.0.54 () {60 vars in 1202 bytes} [Tue Nov 23 04:08:08 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:08:54.416932 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:54.418003 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-ab03342a-52a4-422a-a306-f40b3b48ded5 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Nov 23 04:08:54.418934 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 31/63] 10.222.0.54 () {54 vars in 930 bytes} [Tue Nov 23 04:08:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:08:54.477353 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-f1151dc7-76aa-4a70-bd38-ad01ef713821 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:54.496040 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-f1151dc7-76aa-4a70-bd38-ad01ef713821 admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070658 Nov 23 04:08:54.496668 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 33/64] 10.222.0.54 () {60 vars in 1291 bytes} [Tue Nov 23 04:08:54 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:08:54.520389 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-c6c44aa9-d1ef-4fd5-9093-4ddcebe140de admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:54.528783 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-c6c44aa9-d1ef-4fd5-9093-4ddcebe140de admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011966 Nov 23 04:08:54.529303 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 32/65] 10.222.0.54 () {60 vars in 1282 bytes} [Tue Nov 23 04:08:54 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:08:54.540652 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-53ba5ad3-ae31-4324-9b6a-f880d9fe3b24 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:54.548302 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-53ba5ad3-ae31-4324-9b6a-f880d9fe3b24 admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011090 Nov 23 04:08:54.548807 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 34/66] 10.222.0.54 () {60 vars in 1285 bytes} [Tue Nov 23 04:08:54 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:08:54.560304 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-71e4df91-c420-4aac-b2e0-555bb11dc4dd admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:54.567665 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-71e4df91-c420-4aac-b2e0-555bb11dc4dd admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010747 Nov 23 04:08:54.568176 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 33/67] 10.222.0.54 () {60 vars in 1285 bytes} [Tue Nov 23 04:08:54 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:08:54.579925 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-fb2bae05-5227-4d07-8f5a-9331f02b4e99 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:08:54.587283 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-fb2bae05-5227-4d07-8f5a-9331f02b4e99 admin admin] 10.222.0.54 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010720 Nov 23 04:08:54.587788 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 35/68] 10.222.0.54 () {60 vars in 1282 bytes} [Tue Nov 23 04:08:54 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:10:45.787933 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-be9426a8-c7fd-4856-8c26-345b9e4c8a08 tempest-verify_tempest_config-964454725 tempest-verify_tempest_config-964454725-project] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:10:45.789920 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-be9426a8-c7fd-4856-8c26-345b9e4c8a08 tempest-verify_tempest_config-964454725 tempest-verify_tempest_config-964454725-project] 10.222.0.54 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108773 Nov 23 04:10:45.790472 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 34/69] 10.222.0.54 () {58 vars in 1133 bytes} [Tue Nov 23 04:10:45 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:12:20.114554 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-fb2bae05-5227-4d07-8f5a-9331f02b4e99 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:12:20.115598 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-fb2bae05-5227-4d07-8f5a-9331f02b4e99 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Nov 23 04:12:20.115994 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 36/70] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:12:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:12:20.366234 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-e3084ba1-145b-4f3e-a88b-dfa810861828 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:12:20.367494 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:12:20.367494 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: warnings.warn(msg) Nov 23 04:12:20.369015 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-e3084ba1-145b-4f3e-a88b-dfa810861828 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:12:20.369478 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-e3084ba1-145b-4f3e-a88b-dfa810861828 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:12:20.370297 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-e3084ba1-145b-4f3e-a88b-dfa810861828 admin admin] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:12:20.370721 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-e3084ba1-145b-4f3e-a88b-dfa810861828 admin admin] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:12:20.403397 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-e3084ba1-145b-4f3e-a88b-dfa810861828 admin admin] 10.222.0.54 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.147515 Nov 23 04:12:20.403950 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 35/71] 10.222.0.54 () {60 vars in 1193 bytes} [Tue Nov 23 04:12:20 2021] GET /compute/v2.1/os-services => generated 794 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:12:21.792748 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-fb2bae05-5227-4d07-8f5a-9331f02b4e99 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:12:21.794024 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-fb2bae05-5227-4d07-8f5a-9331f02b4e99 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001763 Nov 23 04:12:21.794414 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 37/72] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:12:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:12:21.991581 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-14b1784c-336b-41e7-bc38-01eba373bc2e admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:12:21.992722 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:12:21.992722 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: warnings.warn(msg) Nov 23 04:12:21.994233 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-14b1784c-336b-41e7-bc38-01eba373bc2e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:12:21.994665 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-14b1784c-336b-41e7-bc38-01eba373bc2e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:12:21.995495 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-14b1784c-336b-41e7-bc38-01eba373bc2e admin admin] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:12:21.995916 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-14b1784c-336b-41e7-bc38-01eba373bc2e admin admin] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:12:22.014173 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-14b1784c-336b-41e7-bc38-01eba373bc2e admin admin] 10.222.0.54 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073709 Nov 23 04:12:22.014705 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 36/73] 10.222.0.54 () {60 vars in 1193 bytes} [Tue Nov 23 04:12:21 2021] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:12:33.848013 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-fb2bae05-5227-4d07-8f5a-9331f02b4e99 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:12:33.849007 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-fb2bae05-5227-4d07-8f5a-9331f02b4e99 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Nov 23 04:12:33.849405 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 38/74] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:12:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:12:34.042406 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-681ce4fe-9344-420f-af4d-2b5c56f5016c admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:12:34.043878 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:12:34.043878 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: warnings.warn(msg) Nov 23 04:12:34.046374 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-681ce4fe-9344-420f-af4d-2b5c56f5016c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:12:34.046792 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-681ce4fe-9344-420f-af4d-2b5c56f5016c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:12:34.047614 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-681ce4fe-9344-420f-af4d-2b5c56f5016c admin admin] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:12:34.048036 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-681ce4fe-9344-420f-af4d-2b5c56f5016c admin admin] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:12:34.071763 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-681ce4fe-9344-420f-af4d-2b5c56f5016c admin admin] 10.222.0.54 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.081429 Nov 23 04:12:34.072316 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 37/75] 10.222.0.54 () {60 vars in 1193 bytes} [Tue Nov 23 04:12:33 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:12:35.475030 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: DEBUG nova.api.openstack.wsgi [None req-fb2bae05-5227-4d07-8f5a-9331f02b4e99 admin admin] Calling method '>' {{(pid=102591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:12:35.476063 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: INFO nova.api.openstack.requestlog [None req-fb2bae05-5227-4d07-8f5a-9331f02b4e99 admin admin] 10.222.0.54 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 23 04:12:35.476462 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: [pid: 102591|app: 0|req: 39/76] 10.222.0.54 () {56 vars in 1074 bytes} [Tue Nov 23 04:12:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:12:35.669033 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-29ee5e8d-b384-4890-89a9-a47b93c2eddc admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:12:35.671382 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:12:35.671382 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: warnings.warn(msg) Nov 23 04:12:35.672905 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-29ee5e8d-b384-4890-89a9-a47b93c2eddc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:12:35.673353 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-29ee5e8d-b384-4890-89a9-a47b93c2eddc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:12:35.674154 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-29ee5e8d-b384-4890-89a9-a47b93c2eddc admin admin] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:12:35.674585 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-29ee5e8d-b384-4890-89a9-a47b93c2eddc admin admin] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:12:35.696889 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-29ee5e8d-b384-4890-89a9-a47b93c2eddc admin admin] 10.222.0.54 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078374 Nov 23 04:12:35.697384 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 38/77] 10.222.0.54 () {60 vars in 1193 bytes} [Tue Nov 23 04:12:35 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:13:33.236741 dv-cinder-768458-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 23 04:13:33.239730 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: Tue Nov 23 04:13:33 2021 - graceful shutdown triggered... Nov 23 04:13:33.240202 dv-cinder-768458-16-iscsi devstack@n-api.service[102591]: Gracefully killing worker 1 (pid: 102591)... Nov 23 04:13:33.240577 dv-cinder-768458-16-iscsi devstack@n-api.service[102592]: Gracefully killing worker 2 (pid: 102592)... Nov 23 04:13:34.238222 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: worker 1 buried after 1 seconds Nov 23 04:13:34.238474 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: worker 2 buried after 1 seconds Nov 23 04:13:34.238474 dv-cinder-768458-16-iscsi devstack@n-api.service[102590]: goodbye to uWSGI. Nov 23 04:13:34.239901 dv-cinder-768458-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 23 04:13:34.240451 dv-cinder-768458-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 23 04:13:34.243310 dv-cinder-768458-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 23 04:13:34.254056 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 04:13:34 2021] *** Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: nodename: dv-cinder-768458-16-iscsi Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: machine: x86_64 Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: clock source: unix Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: pcre jit disabled Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: detected number of CPU cores: 4 Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: current working directory: / Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: detected binary path: /usr/bin/uwsgi-core Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: your processes number limit is 47680 Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: your memory page size is 4096 bytes Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: detected max file descriptor number: 2048 Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: lock engine: pthread robust mutexes Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: thunder lock: enabled Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 23 04:13:34.260064 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 04:13:34.303333 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: Python main interpreter initialized at 0x558eff2b69c0 Nov 23 04:13:34.303333 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: python threads support enabled Nov 23 04:13:34.303333 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: your server socket listen backlog is limited to 100 connections Nov 23 04:13:34.303333 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: your mercy for graceful operations on workers is 90 seconds Nov 23 04:13:34.303333 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 04:13:34.303333 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: *** Operational MODE: preforking *** Nov 23 04:13:34.303333 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: *** uWSGI is running in multiple interpreter mode *** Nov 23 04:13:34.303333 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: spawned uWSGI master process (pid: 116816) Nov 23 04:13:34.303127 dv-cinder-768458-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 23 04:13:34.305994 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: spawned uWSGI worker 1 (pid: 116836, cores: 1) Nov 23 04:13:34.317433 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: spawned uWSGI worker 2 (pid: 116837, cores: 1) Nov 23 04:13:34.317433 dv-cinder-768458-16-iscsi devstack@n-api.service[116816]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 04:13:36.088005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 04:13:36.088005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: from cryptography.utils import int_from_bytes Nov 23 04:13:36.088715 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 04:13:36.088715 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: from cryptography.utils import int_from_bytes Nov 23 04:13:36.090500 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 04:13:36.090500 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: from cryptography.utils import int_from_bytes Nov 23 04:13:36.091964 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 04:13:36.091964 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: from cryptography.utils import int_from_bytes Nov 23 04:13:38.420483 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 04:13:38.421007 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 04:13:38.421244 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 04:13:38.421613 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 04:13:38.421875 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 04:13:38.422269 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.422604 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.422935 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.423289 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.423631 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.423949 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.424279 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.424608 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.424945 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.425213 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.425541 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.425871 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-16-iscsi {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.426200 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.426525 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.426838 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.427162 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.427511 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.427841 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.428165 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.428668 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.429126 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.429447 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.429765 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.430109 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.430432 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.430747 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.431074 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.431417 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.431747 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.432065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.432470 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-16-iscsi {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.432796 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.433116 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.433438 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.433858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.434178 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.435028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.435515 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.436095 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.436280 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.436620 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.437509 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.437509 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.437669 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.437888 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.438191 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.438509 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.438835 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.439149 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.439492 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.439750 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.440065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.440392 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.440712 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 04:13:38.441118 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.441207 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 04:13:38.441290 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.441290 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.441560 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 04:13:38.441661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.441833 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 04:13:38.441926 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.442074 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 04:13:38.442180 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.442459 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.442567 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.442773 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.442878 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.443088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.443231 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.443431 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.443636 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.443814 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.443980 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.444137 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.444319 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.444494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.444669 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.444812 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.444953 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.445175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.445380 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.445380 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.445688 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.445840 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.446035 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.446283 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-16-iscsi {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.446443 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.446640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.446802 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.446952 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.447100 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.54 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.447323 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.447497 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.54 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.447668 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.447850 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.448045 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.448198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.448378 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.448539 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.448684 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.448833 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.448833 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.449124 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.449284 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.449439 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.449598 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.449751 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.449893 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.450051 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.450844 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.451311 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.451475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.451621 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.451776 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.451927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.452075 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.452225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.452388 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.452564 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.452727 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.452877 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.453025 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.453174 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.453322 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.453470 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-16-iscsi {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.453626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.453776 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.453932 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.454085 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.454244 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.454395 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.454544 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.454544 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.454823 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.454965 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.455106 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.455280 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.455435 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.455587 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.455731 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.455881 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.456035 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.456198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.456347 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.456489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.456639 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.456791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.456939 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.457089 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.457239 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.457389 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.457539 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.457693 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.457842 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.457995 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.458147 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.458299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.458441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.458603 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.458749 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.458891 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.459040 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.459196 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.459392 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.459392 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.459673 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.459822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.459988 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.460131 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.460272 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.460419 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.460568 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.460724 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.460876 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.461019 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.461292 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.461534 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.461684 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.461846 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.462007 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.462156 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.462299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.462440 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.462598 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.462752 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.462904 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.463055 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.463196 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.463364 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.463522 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.463672 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.463813 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.463972 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.464123 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.464276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.464427 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.464570 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.464710 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.464933 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.465077 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.465219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.465369 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.465519 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.465661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.465839 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.466095 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.466338 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.466489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.466641 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.54 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.466790 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.466932 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.54 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.467081 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.467262 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.467422 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.467571 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.467714 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.467863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.467863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.468160 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.468311 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.468461 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.468621 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.468772 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.468922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.469080 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.469222 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.469364 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.469514 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.469664 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.469821 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.469980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.470202 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.470351 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.470559 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.470726 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.470883 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.471026 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.471175 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.471452 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.471715 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.471876 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.472094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.472260 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.472403 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.472403 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.472693 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.472842 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.473004 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.473153 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.473312 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.473462 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.473611 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.473764 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.473912 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.474054 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.474217 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.474369 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.474511 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.474662 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.474811 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.474961 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.475111 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.475298 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.475453 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.475680 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.475832 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.475974 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.476123 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.476278 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.476465 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.476620 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.476764 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.476905 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.476905 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.477182 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.477332 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.477482 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.477631 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.477773 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.477923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.478071 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.478246 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.478387 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.478623 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.478780 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.478929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.479078 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.479256 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.479406 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.479548 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.479701 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.479851 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.479999 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.480159 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.480300 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.480441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.480596 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.480822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.480975 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.481116 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.481258 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.481481 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.481637 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.481890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.482047 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.482198 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.482198 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.482497 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.482647 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.482798 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.482949 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.483099 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.483279 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.483428 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.483578 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.483728 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.483728 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.483998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.484145 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.484297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.484451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.484592 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.484742 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.484884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.485034 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.485190 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.485331 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.485480 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.485635 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.485776 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.485997 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.486155 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.486155 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 04:13:38.486436 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.486436 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.486712 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.486853 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.487013 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.487158 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.487336 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.487486 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.487639 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.487788 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.487944 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.488099 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.488241 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.488383 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.488539 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.488692 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.488840 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.488981 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.489137 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.489287 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.489437 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.489588 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.489734 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.489876 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.490030 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.490171 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.490314 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.490464 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.490611 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.490753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.490975 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.491126 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.491354 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.491512 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.491661 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.491811 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.492067 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.492229 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.492382 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.492525 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.492666 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.492807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.492961 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.493110 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.493261 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.493410 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.493552 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.493693 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.493845 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.494004 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.494282 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.494437 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.494585 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.494739 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.494882 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.495038 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.495188 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.495368 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.495518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.495669 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.495812 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.495964 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.496125 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.496281 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.496431 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.496580 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.496723 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.496881 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.497531 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.497685 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.497828 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.498033 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.498184 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.498340 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.498494 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.498656 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.498806 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.498955 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.499114 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.499287 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.499443 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.499626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.499806 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.499806 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.500148 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.500298 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.500466 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.500616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.500778 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.501102 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.501275 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.501443 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.501587 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.501728 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.501989 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.502254 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.502426 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.502577 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.502720 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.502869 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.503024 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.503166 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.503373 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.503519 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.503668 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.503818 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.503968 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.504123 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.504274 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.504417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.504558 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.504701 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.504843 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.505007 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.505150 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.505291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.505440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.505589 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.505744 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.505895 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.506039 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.506180 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.506329 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.506481 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.506637 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.506796 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.506950 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.507101 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.507276 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.507469 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.507652 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.507809 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.507952 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.508141 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.508323 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.508485 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.508642 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.508830 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.508997 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.509155 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.509306 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.509456 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.509612 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.509763 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.509916 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.510069 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.510220 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.510362 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.510512 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.510661 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.510661 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.510931 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.511095 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.511414 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.511626 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.511789 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.511991 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.512145 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.513878 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.514068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.514226 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.514372 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.514528 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.514671 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.514836 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.514991 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.515142 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.515327 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.515481 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.515667 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.515892 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.516054 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.516227 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.516375 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.516518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.516661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.516894 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.517457 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.517884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.518045 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.518227 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.518385 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.518555 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.518709 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.518852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.518994 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.518994 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.519370 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.519579 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.519751 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.519908 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.520098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.520261 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.520415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.520415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.520815 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.520967 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.521117 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.521266 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.521409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.521566 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.521717 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.521861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.522024 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.522168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.522319 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.522468 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.522617 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.522760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.522909 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.523058 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.523227 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.523387 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.523531 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.523680 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.523823 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.524096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.524257 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.524407 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.524558 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.524711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.524853 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.525004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.525160 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.525310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.525452 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.525594 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.525735 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.525901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.526045 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.526187 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.526328 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.526469 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.526628 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.526859 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.527011 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.527160 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.527352 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.527496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.527638 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.527796 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.527957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.528100 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.528287 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.528446 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.528590 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.528746 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.528890 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.529039 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.529183 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.529324 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.529480 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.529622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.529770 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.529931 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.530082 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.530225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.530376 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.530525 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.530525 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.530796 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.530937 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.531086 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.531274 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.531435 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.531585 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.531734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.531894 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.532043 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.532309 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.532458 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.532609 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.532752 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.532901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.533058 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.533200 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.533350 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.533493 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.533634 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.533786 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.533942 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.533942 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.534212 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.534468 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.534635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.534784 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.534943 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.535092 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.535273 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.535431 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.535590 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.535740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.535909 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.535909 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.536193 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.536341 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.536491 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.536649 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.536805 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.536954 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.537109 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.537265 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.537414 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.537572 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.537733 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.537953 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.538134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.538301 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.538495 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.538664 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.538825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.538976 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.539123 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.539308 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.539471 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.539623 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.539771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.539927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.540097 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.540269 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.540427 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.541817 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.541982 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.542140 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.542306 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.542456 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.542612 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.542773 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.542929 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.543079 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.543298 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.543457 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.543614 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.543765 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.543942 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.544103 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.544256 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.544477 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.544632 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.544900 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.545063 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.545226 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.545390 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.545560 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.545749 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.545954 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.546113 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.546277 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.546433 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.546582 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.546738 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.546887 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.547036 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.547036 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.547353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.547514 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.547675 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.547825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.547989 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.548139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.548301 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.548461 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.548618 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.548618 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.548911 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.548911 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.549211 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.549368 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.549516 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.549681 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.549840 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.549996 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.550146 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.550293 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.550440 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.550596 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.550759 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.550922 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.551072 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.551274 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.551441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.551614 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.551765 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.551913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.552074 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.552231 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.552387 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.552549 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.552706 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.552862 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.553018 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.553167 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.553323 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.553494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.553655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.553811 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.553968 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.554117 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.554267 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.554429 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.554586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.554735 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.554911 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.555154 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.555356 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.555472 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.555572 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.555666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.555758 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.555842 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.555990 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556084 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556177 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556260 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556354 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556437 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556517 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556604 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556699 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556782 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556874 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.556956 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557044 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557132 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557316 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557537 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557637 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557757 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557834 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.557991 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558062 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558266 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558348 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558425 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558495 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558643 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558724 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558809 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558879 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.558954 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.559024 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.559092 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.559169 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.559403 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.559994 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560144 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560242 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560312 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560397 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560492 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560693 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560770 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560840 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560921 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.560991 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.561066 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.561143 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.561319 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.561428 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.561525 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.561616 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.561708 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.561803 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.561894 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.562038 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.562151 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.562267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.562385 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.562503 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.562622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.562622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.562847 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.562847 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.563068 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.563179 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.563338 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.563463 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.563574 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.563705 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.563822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.563937 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564052 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564174 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564401 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564527 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564645 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564765 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564874 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564981 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564981 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564981 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.564981 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.565517 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.565636 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.565745 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.565862 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.565971 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.566086 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.566218 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.566338 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.566446 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.566569 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.566669 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.566753 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.566753 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.566911 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.566992 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.567072 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.567153 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.567267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.567267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.567267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.567502 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.570487 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.570606 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.570713 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.570802 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.570886 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.570978 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571070 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571286 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571382 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571465 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571547 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571628 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571708 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571798 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571887 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.571980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.572445 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.572565 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.572749 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.572927 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.573102 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.573257 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.573414 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.573581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.573806 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.573976 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.574127 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.574300 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.574454 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.574611 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.574768 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.574927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.575077 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.576079 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.576240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.576797 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.576969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.577129 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.577288 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.577439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.577615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.578068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.578240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.578401 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.578551 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.578700 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.578860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.579018 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.579182 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.579362 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.579634 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.579791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.579940 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.580088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.580254 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.580411 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.580560 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.580709 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.580864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.581093 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.581253 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.581404 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.581553 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.581721 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.582435 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.582611 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.582770 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.582920 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.583081 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.583290 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.583464 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.583643 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.583819 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.584046 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.584199 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.584349 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.584498 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.584664 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.584823 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.584974 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.584974 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.585266 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.585429 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.585587 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.585748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.585897 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.586052 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.586200 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.586362 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.586520 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.586699 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.587021 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.587185 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.587360 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.587523 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.587673 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.587851 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.588273 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.588439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.588596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.588760 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.588912 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.589061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.589209 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.589357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.589515 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.589753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.589909 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.590059 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.590228 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.590394 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.590394 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.590881 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.591063 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.591260 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.591465 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.591635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.591795 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.591953 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.592393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.592615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.592930 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.593174 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.593349 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.593524 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.593739 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.593957 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.594392 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.594392 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.594785 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.594947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.595098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.595280 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.595280 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.595586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.595749 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.595906 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.596063 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.596222 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.596379 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.596379 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.596682 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.596831 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.597167 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.597326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.597326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.597627 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.597785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.597785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.598109 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.598538 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.598710 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.598876 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.599034 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.599183 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.599395 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.599561 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.599736 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.599969 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.600124 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.600292 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.600443 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.600609 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.600759 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.600916 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.601065 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.601358 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.601565 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.601737 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.601891 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.602049 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.602200 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.602348 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.602529 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.602687 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.602837 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.602986 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.602986 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.603315 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.603478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.603640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.603790 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.603938 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.604087 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.604267 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.604489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.604690 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.604840 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.604990 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.605139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.605308 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.605469 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.605620 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.605777 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.605933 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.606082 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.606313 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.606515 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.607228 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.607504 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.607669 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.607829 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.607989 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.608140 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.608573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.608751 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.608905 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.609054 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.609216 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.609366 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.609522 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.609684 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.609842 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.610090 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.610258 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.610408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.610557 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.610714 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.610877 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.611037 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.611037 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.611037 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.611037 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.611633 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.611806 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.611970 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.612127 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.612277 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.612441 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.612599 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.612759 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.612919 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.613069 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.613218 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.613449 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.613610 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.613779 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.613941 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.614098 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.614248 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.614397 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.614641 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.614807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.614965 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.615117 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.615285 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.615447 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.615608 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.615772 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.615941 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.616092 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.616242 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.616242 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.616556 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.616713 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.616869 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.617028 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.617205 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.617434 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.617706 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.617706 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.618009 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.618169 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.618318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.618486 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.618919 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.619071 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.619239 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.619396 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.619558 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.619722 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.619871 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.620035 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.620273 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.620448 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.620607 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.620771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.620929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.621095 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.621257 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.621407 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.621574 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.621766 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.621922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.622602 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.622763 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.622925 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.623084 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.623265 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.623433 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.623584 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.623743 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.623893 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.624056 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.624207 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.624207 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.624508 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.624677 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.624898 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.625073 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.625231 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.625380 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.625536 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.625536 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.625842 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.625997 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.626145 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.626294 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.626450 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.626600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.626763 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.626934 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.627084 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.627252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.627436 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.627681 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.627935 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.627935 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.628225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.628373 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.628522 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.628950 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.629121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.629272 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.629442 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.629604 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.629754 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.629913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.630063 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.630211 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.630448 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.630603 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.630761 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.630927 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.631077 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.631077 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.631425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.631425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.631755 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.631755 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.632051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.632209 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.632365 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.632515 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.632663 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.632820 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.633070 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.633225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.633374 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.633566 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.633776 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.633936 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.634096 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.634252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.634408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.634556 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.634714 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.634888 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.635111 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.635291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.635447 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.635596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.635784 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.635940 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.636091 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.636240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.636396 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.636559 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.636709 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.636866 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.637015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.637173 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.637322 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.637483 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.638427 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.638427 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.638768 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.639185 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.639392 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.639558 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.639718 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.639876 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.640026 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.640183 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.640351 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.641161 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.641333 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.641484 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.641654 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.641812 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.641971 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.642131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.642280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.642442 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.642592 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.642755 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.642986 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.643147 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.643324 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.643488 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.643650 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.643817 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.643980 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.644130 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.644130 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.644422 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.644572 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.644729 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.644888 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.645046 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.645292 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.645455 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.645607 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.645792 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.645953 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.646104 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.646266 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.646415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.646578 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.646738 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.646896 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.647046 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.647202 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.647385 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.647548 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.647709 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.647866 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.648024 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.648196 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.648346 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.648346 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.648835 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.649275 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.649440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.649632 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.649801 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.649962 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.650132 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.650289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.650439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.650596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.650754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.650983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.651155 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.651411 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.651581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.651732 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.651892 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.652051 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.652201 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.652371 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.652530 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.652688 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.652848 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.652997 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.653154 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.653342 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.653569 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.653569 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.654019 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.654175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.654340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.654505 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.654730 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.654909 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.655064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.655240 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.655471 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.655625 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.655796 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.655958 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.656110 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.656266 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.656424 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.656582 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.656742 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.656906 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.657058 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.657207 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.657363 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.657513 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.657670 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.657829 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.657980 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.658137 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.658295 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.658452 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.658628 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.658983 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.659468 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.659628 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.659628 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.659939 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.660100 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.660262 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.660412 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.660562 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.660719 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.660876 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.661035 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.661197 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.661523 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.661684 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.661684 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.661987 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.662146 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.662304 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.662304 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.662612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.662762 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.662920 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.663078 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.663281 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.663449 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.663608 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.663765 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.663926 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.664077 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.664233 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.664392 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.664543 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.664702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.664852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.665007 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.665165 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.665325 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.665501 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.665762 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.666173 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.666324 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.666475 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.666633 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.666788 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.666947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.667096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.667264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.667436 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.667595 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.667756 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.667915 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.668064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.668221 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.668370 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.668518 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.668685 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.669132 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.669675 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.669838 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.670027 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.670184 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.670359 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.670511 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.670662 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.670811 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.670961 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.671117 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.671357 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.671804 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.671964 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.672123 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.672284 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.672443 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.672604 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.672775 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.672935 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.673085 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.673236 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.673393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.673393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.673393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.673393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.673393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.673393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.673393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.673393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.674560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.674560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.674560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.674560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.674560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.674560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.674560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.674560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.675739 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.675739 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.675739 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.676287 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.676440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.676608 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.676765 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.676929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.677088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.677239 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.677388 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.677545 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.677703 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.677862 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.678013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.678013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 04:13:38.678296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.678296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.678296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.678296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.678296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.678296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.680355 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.680721 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.681058 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.681394 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.681744 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.682079 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.682408 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.682736 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.683060 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.683444 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.683771 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.684093 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.684414 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.685383 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.685656 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.686041 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.686279 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.686604 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.686928 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.687278 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.687603 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.687922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.688240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.688621 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.688951 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.689292 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.690061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.690061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.690528 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.690768 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.691099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.691704 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.691899 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.692169 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.694864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.694864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.694864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.694864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.694864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.694864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.694864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.694864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.696838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.696838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.696838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.696838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.696838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.696838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.698108 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_db.sqlalchemy.engines [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:13:38.698340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.698340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.698340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.698340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.698340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.699432 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.699432 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.699432 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.701402 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.701402 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.701402 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.701402 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.702333 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.702333 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.702646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.702879 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.703236 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.703578 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.703895 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.704229 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.704552 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.704880 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.705206 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.706496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.706496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.706496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.706496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.707110 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.707321 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.707597 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.707923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.708256 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.708586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.708919 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.709250 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.709612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.710068 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.710425 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.710675 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.711280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.711449 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.711655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 04:13:38.711904 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 04:13:38.736087 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_db.sqlalchemy.engines [None req-3083e472-1e37-4397-9797-426c152844c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:13:38.858187 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.context [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f047aa68-6146-4dc8-a7df-79b907216663(cell1) {{(pid=116837) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 04:13:38.862745 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:13:38.864382 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:13:38.865245 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:13:38.867252 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:13:38.879079 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_db.sqlalchemy.engines [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:13:38.880667 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_db.sqlalchemy.engines [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:13:38.895731 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.context [None req-3083e472-1e37-4397-9797-426c152844c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f047aa68-6146-4dc8-a7df-79b907216663(cell1) {{(pid=116836) load_cells /opt/stack/nova/nova/context.py:464}} Nov 23 04:13:38.900236 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3083e472-1e37-4397-9797-426c152844c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:13:38.901744 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3083e472-1e37-4397-9797-426c152844c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:13:38.902578 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3083e472-1e37-4397-9797-426c152844c0 None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:13:38.905090 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3083e472-1e37-4397-9797-426c152844c0 None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:13:38.916076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_db.sqlalchemy.engines [None req-3083e472-1e37-4397-9797-426c152844c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:13:38.916951 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_db.sqlalchemy.engines [None req-3083e472-1e37-4397-9797-426c152844c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:13:39.039465 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_db.sqlalchemy.engines [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:13:39.080386 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_db.sqlalchemy.engines [None req-3083e472-1e37-4397-9797-426c152844c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 04:13:39.364778 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: WARNING keystonemiddleware.auth_token [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 04:13:39.371338 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: WARNING keystonemiddleware.auth_token [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 04:13:39.411183 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: WARNING keystonemiddleware.auth_token [None req-3083e472-1e37-4397-9797-426c152844c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 04:13:39.418047 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: WARNING keystonemiddleware.auth_token [None req-3083e472-1e37-4397-9797-426c152844c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 04:13:39.719769 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: WARNING keystonemiddleware.auth_token [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 04:13:39.725357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: WARNING keystonemiddleware.auth_token [None req-08c3710b-b1db-45ce-bd5c-4499643f0fcf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 04:13:39.730855 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558eff2b69c0 pid: 116837 (default app) Nov 23 04:13:39.768117 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: WARNING keystonemiddleware.auth_token [None req-3083e472-1e37-4397-9797-426c152844c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 23 04:13:39.773386 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: WARNING keystonemiddleware.auth_token [None req-3083e472-1e37-4397-9797-426c152844c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 23 04:13:39.779630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558eff2b69c0 pid: 116836 (default app) Nov 23 04:14:15.777869 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b58531d8-bb53-4640-acbd-212e0b630bf5 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] Action: 'create', calling method: .version_select at 0x7fa7df5f64c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1974873516", "metadata": {"Type": "work"}}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:15.805608 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7fa8a743-92c1-4729-8a57-72014d0604a4 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Action: 'create', calling method: .version_select at 0x7fa7df5f54c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-535353065", "metadata": {"Type": "work"}}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:15.807321 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7fa8a743-92c1-4729-8a57-72014d0604a4 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:14:15.808236 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7fa8a743-92c1-4729-8a57-72014d0604a4 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] 10.222.0.54 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.104373 Nov 23 04:14:15.813412 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 1/1] 10.222.0.54 () {60 vars in 1155 bytes} [Tue Nov 23 04:14:14 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 04:14:15.961265 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1710396762", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "networks": [{"uuid": "3f225ae5-6bd1-4fef-a8a2-1e95224823f9"}]}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:16.362580 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] validate_networks() for [('3f225ae5-6bd1-4fef-a8a2-1e95224823f9', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:14:17.333602 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b58531d8-bb53-4640-acbd-212e0b630bf5 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] 10.222.0.54 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.673607 Nov 23 04:14:17.334244 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 1/2] 10.222.0.54 () {60 vars in 1155 bytes} [Tue Nov 23 04:14:14 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2677 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 23 04:14:17.339274 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-edf538d8-cde3-4b2c-ad22-4366b37e2cd3 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Action: 'create', calling method: .version_select at 0x7fa7df5780d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2040803529", "metadata": {"Type": "work"}}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:17.343834 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-edf538d8-cde3-4b2c-ad22-4366b37e2cd3 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:14:17.344704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-edf538d8-cde3-4b2c-ad22-4366b37e2cd3 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] 10.222.0.54 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009151 Nov 23 04:14:17.345320 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 2/3] 10.222.0.54 () {60 vars in 1155 bytes} [Tue Nov 23 04:14:17 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 04:14:17.352610 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-dc5eae7d-58ae-4671-82d0-2fd43b86401a tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] Calling method '.version_select at 0x7fa7dfe9aaf0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:17.468371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-dc5eae7d-58ae-4671-82d0-2fd43b86401a tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f" status: 200 len: 353 microversion: 2.1 time: 0.121649 Nov 23 04:14:17.473190 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 3/4] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:14:17 2021] GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:17.473702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-99e7f846-9c35-413e-8c41-117622addac1 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Action: 'create', calling method: .version_select at 0x7fa7df4bf1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-728912655", "metadata": {"Type": "work"}}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:17.474980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-99e7f846-9c35-413e-8c41-117622addac1 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:14:17.475720 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-99e7f846-9c35-413e-8c41-117622addac1 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] 10.222.0.54 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005820 Nov 23 04:14:17.478052 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 4/5] 10.222.0.54 () {60 vars in 1155 bytes} [Tue Nov 23 04:14:17 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 04:14:17.490552 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6e9b260f-9c3c-4736-bad3-8063f2d22f61 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Calling method '.version_select at 0x7fa7df4d3550>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:17.491881 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:14:17.492405 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:14:17.493005 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:14:17.493420 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:14:17.493824 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:14:17.522505 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:17.523415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:17.524496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:17.525112 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:17.542745 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-6e9b260f-9c3c-4736-bad3-8063f2d22f61 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] HTTP exception thrown: Volume tempest-invalid-1646571004 could not be found. Nov 23 04:14:17.543478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6e9b260f-9c3c-4736-bad3-8063f2d22f61 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Returning 404 to user: Volume tempest-invalid-1646571004 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:14:17.551737 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6e9b260f-9c3c-4736-bad3-8063f2d22f61 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] 10.222.0.54 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1646571004" status: 404 len: 99 microversion: 2.1 time: 0.062128 Nov 23 04:14:17.551737 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 5/6] 10.222.0.54 () {58 vars in 1217 bytes} [Tue Nov 23 04:14:17 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1646571004 => generated 99 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 23 04:14:17.555947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-55d174bd-85f4-4799-b0e1-533afac38c0c tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] 10.222.0.54 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004625 Nov 23 04:14:17.557123 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 6/7] 10.222.0.54 () {58 vars in 1139 bytes} [Tue Nov 23 04:14:17 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 23 04:14:17.568866 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Getting quotas for project dc51e914f5e74ceca4086caa5a05b8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:14:17.569537 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-16abe300-604a-4ce5-8ea5-afa1d6cc7c2d tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006298 Nov 23 04:14:17.570656 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 7/8] 10.222.0.54 () {58 vars in 1136 bytes} [Tue Nov 23 04:14:17 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 23 04:14:17.581831 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5798d2d8-57d8-46bc-b850-8d7be35f67f9 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Calling method '.version_select at 0x7fa7df4bfdc0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:17.586684 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Getting quotas for user 882a63823deb40dcb93ddc76f81ab9d0 and project dc51e914f5e74ceca4086caa5a05b8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:14:17.609418 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:14:17.614526 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:14:17.647134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-5798d2d8-57d8-46bc-b850-8d7be35f67f9 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] HTTP exception thrown: Volume 7fe83c54-9c3b-4a95-9bb6-dfe111688293 could not be found. Nov 23 04:14:17.647949 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5798d2d8-57d8-46bc-b850-8d7be35f67f9 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Returning 404 to user: Volume 7fe83c54-9c3b-4a95-9bb6-dfe111688293 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:14:17.649764 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5798d2d8-57d8-46bc-b850-8d7be35f67f9 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] 10.222.0.54 "DELETE /compute/v2.1/os-volumes/7fe83c54-9c3b-4a95-9bb6-dfe111688293" status: 404 len: 109 microversion: 2.1 time: 0.072204 Nov 23 04:14:17.650150 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 8/9] 10.222.0.54 () {58 vars in 1247 bytes} [Tue Nov 23 04:14:17 2021] DELETE /compute/v2.1/os-volumes/7fe83c54-9c3b-4a95-9bb6-dfe111688293 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:14:17.659632 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-53d7073b-ce11-4c6c-b0d5-b82864723451 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Calling method '.version_select at 0x7fa7df4bff70>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:17.702405 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-53d7073b-ce11-4c6c-b0d5-b82864723451 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] HTTP exception thrown: Volume c88da583-13bb-4998-a931-d58ed83bed5e could not be found. Nov 23 04:14:17.703131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-53d7073b-ce11-4c6c-b0d5-b82864723451 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] Returning 404 to user: Volume c88da583-13bb-4998-a931-d58ed83bed5e could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:14:17.704067 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-53d7073b-ce11-4c6c-b0d5-b82864723451 tempest-VolumesNegativeTest-1832025109 tempest-VolumesNegativeTest-1832025109-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/c88da583-13bb-4998-a931-d58ed83bed5e" status: 404 len: 109 microversion: 2.1 time: 0.048422 Nov 23 04:14:17.713411 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 9/10] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:14:17 2021] GET /compute/v2.1/os-volumes/c88da583-13bb-4998-a931-d58ed83bed5e => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 04:14:17.867844 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-38d11de8-5a44-4b0a-8bf1-96f5bd7324bd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.052908 Nov 23 04:14:17.874617 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 2/11] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:14:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:14:17.883631 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1d70ee5b-0e74-40ac-9088-a88a00b7dfc6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:17.884418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1d70ee5b-0e74-40ac-9088-a88a00b7dfc6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:18.019857 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1d70ee5b-0e74-40ac-9088-a88a00b7dfc6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:18.061710 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1d70ee5b-0e74-40ac-9088-a88a00b7dfc6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1218 microversion: 2.1 time: 0.185934 Nov 23 04:14:18.062887 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 10/12] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:17 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:18.482965 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-64b7d0ae-823e-4657-a170-d3f0ddf1b456 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] Calling method '.version_select at 0x7fa7df46bca0>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:18.637530 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-247678567", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "networks": [{"uuid": "49ce0af5-9910-4581-af30-0918b54a130e"}]}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:18.667832 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-64b7d0ae-823e-4657-a170-d3f0ddf1b456 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f" status: 200 len: 353 microversion: 2.1 time: 0.189462 Nov 23 04:14:18.670065 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 3/13] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:14:18 2021] GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f => generated 353 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:18.845918 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.network.neutron [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] validate_networks() for [('49ce0af5-9910-4581-af30-0918b54a130e', None, None, None, None, None)] {{(pid=116837) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:14:19.083685 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f64bb4b7-b0a6-4b8c-b302-c56470fa7420 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:19.083685 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f64bb4b7-b0a6-4b8c-b302-c56470fa7420 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:19.275401 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f64bb4b7-b0a6-4b8c-b302-c56470fa7420 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:19.293130 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f64bb4b7-b0a6-4b8c-b302-c56470fa7420 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1218 microversion: 2.1 time: 0.213552 Nov 23 04:14:19.302810 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 4/14] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:19 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1218 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:19.681231 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7d47976a-dd52-4584-8c87-b298c0723d41 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] Calling method '.version_select at 0x7fa7de37e430>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:19.749544 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7d47976a-dd52-4584-8c87-b298c0723d41 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f" status: 200 len: 354 microversion: 2.1 time: 0.071920 Nov 23 04:14:19.756329 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 5/15] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:14:19 2021] GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:19.761047 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6c37e48a-4b63-4dab-88ac-1c50ccf53558 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] Calling method '.version_select at 0x7fa7de38f550>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:19.818167 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6c37e48a-4b63-4dab-88ac-1c50ccf53558 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f" status: 200 len: 354 microversion: 2.1 time: 0.060622 Nov 23 04:14:19.818794 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 6/16] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:14:19 2021] GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:19.835785 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a8825fa1-731e-4c27-8aef-47fa644528ac tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] Calling method '.version_select at 0x7fa7de38fe50>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:20.115827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a8825fa1-731e-4c27-8aef-47fa644528ac tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] 10.222.0.54 "DELETE /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f" status: 202 len: 0 microversion: 2.1 time: 0.281627 Nov 23 04:14:20.115827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 7/17] 10.222.0.54 () {58 vars in 1247 bytes} [Tue Nov 23 04:14:19 2021] DELETE /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:14:20.124184 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bae5bbc0-8113-4d21-a66a-3a8293296867 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] Calling method '.version_select at 0x7fa7de38ff70>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:20.192698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bae5bbc0-8113-4d21-a66a-3a8293296867 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f" status: 200 len: 353 microversion: 2.1 time: 0.072970 Nov 23 04:14:20.194680 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 8/18] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:14:20 2021] GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:20.312296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c76f3ea3-f0fb-46c2-a515-df38509025f9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:20.313233 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c76f3ea3-f0fb-46c2-a515-df38509025f9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:20.321253 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c76f3ea3-f0fb-46c2-a515-df38509025f9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:20.326910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c76f3ea3-f0fb-46c2-a515-df38509025f9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:20.333949 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c76f3ea3-f0fb-46c2-a515-df38509025f9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:20.333949 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c76f3ea3-f0fb-46c2-a515-df38509025f9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:20.466237 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Flavor limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:14:20.466816 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Image limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:14:20.467466 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Flavor pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:14:20.467893 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Image pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:14:20.468303 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:14:20.506855 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:20.506855 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:20.506855 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:20.506855 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:20.585518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c76f3ea3-f0fb-46c2-a515-df38509025f9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:20.597966 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c76f3ea3-f0fb-46c2-a515-df38509025f9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1222 microversion: 2.1 time: 0.291880 Nov 23 04:14:20.605083 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Getting quotas for project 04145637610344c69dd78ebf3ecd92ed. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:14:20.608281 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 9/19] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:20 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1222 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:20.629970 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Getting quotas for user 9c04ecf61bb2468a99223a57cb41fd18 and project 04145637610344c69dd78ebf3ecd92ed. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:14:20.668370 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Going to run 1 instances... {{(pid=116837) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:14:20.679302 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:14:20.994088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f6c7c32a-8919-4cf1-ae25-7b2db0685749 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.502804 Nov 23 04:14:21.000734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 11/20] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:14:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 04:14:21.006811 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-52c3e676-f752-441a-9387-8d99ccdf2d39 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:21.008312 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-52c3e676-f752-441a-9387-8d99ccdf2d39 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:21.208448 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-334c0674-1cdd-4d35-9c85-e559504c28f4 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] Calling method '.version_select at 0x7fa7df3fea60>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:21.265581 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-52c3e676-f752-441a-9387-8d99ccdf2d39 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:21.274441 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-334c0674-1cdd-4d35-9c85-e559504c28f4 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] HTTP exception thrown: Volume 306f9e14-9ec4-4408-afad-806b9055a75f could not be found. Nov 23 04:14:21.274441 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-334c0674-1cdd-4d35-9c85-e559504c28f4 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] Returning 404 to user: Volume 306f9e14-9ec4-4408-afad-806b9055a75f could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:14:21.276397 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-334c0674-1cdd-4d35-9c85-e559504c28f4 tempest-VolumesGetTestJSON-1428469410 tempest-VolumesGetTestJSON-1428469410-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f" status: 404 len: 109 microversion: 2.1 time: 0.070035 Nov 23 04:14:21.276975 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 12/21] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:14:21 2021] GET /compute/v2.1/os-volumes/306f9e14-9ec4-4408-afad-806b9055a75f => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 04:14:21.280952 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-52c3e676-f752-441a-9387-8d99ccdf2d39 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1214 microversion: 2.1 time: 0.275295 Nov 23 04:14:21.289179 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 10/22] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:21 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1214 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:21.614934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6efd0eac-d566-4085-9e7b-6434a645d7ee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:21.615595 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6efd0eac-d566-4085-9e7b-6434a645d7ee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:21.631498 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6efd0eac-d566-4085-9e7b-6434a645d7ee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:21.631961 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6efd0eac-d566-4085-9e7b-6434a645d7ee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:21.632766 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6efd0eac-d566-4085-9e7b-6434a645d7ee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:21.633207 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6efd0eac-d566-4085-9e7b-6434a645d7ee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:21.946380 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6efd0eac-d566-4085-9e7b-6434a645d7ee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:21.968708 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6efd0eac-d566-4085-9e7b-6434a645d7ee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1214 microversion: 2.1 time: 0.355014 Nov 23 04:14:21.969883 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 13/23] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:21 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1214 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:22.296976 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a3640947-0786-4750-98c5-71ae069b1aa7 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:22.298227 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a3640947-0786-4750-98c5-71ae069b1aa7 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:22.405225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a3640947-0786-4750-98c5-71ae069b1aa7 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:22.419008 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a3640947-0786-4750-98c5-71ae069b1aa7 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1214 microversion: 2.1 time: 0.126106 Nov 23 04:14:22.435731 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 11/24] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:22 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:22.989598 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-860b0ea2-75a7-4a13-bfbe-7a4782a53407 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:22.990368 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-860b0ea2-75a7-4a13-bfbe-7a4782a53407 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:23.010511 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-860b0ea2-75a7-4a13-bfbe-7a4782a53407 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:23.011499 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-860b0ea2-75a7-4a13-bfbe-7a4782a53407 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:23.014608 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-860b0ea2-75a7-4a13-bfbe-7a4782a53407 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:23.015404 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-860b0ea2-75a7-4a13-bfbe-7a4782a53407 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:23.260730 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-860b0ea2-75a7-4a13-bfbe-7a4782a53407 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:23.284901 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-860b0ea2-75a7-4a13-bfbe-7a4782a53407 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1270 microversion: 2.1 time: 0.301940 Nov 23 04:14:23.285422 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 14/25] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:22 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1270 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:23.440952 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e4c3225e-4fc4-4b1a-b9fe-2f7ef517e17a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:23.441576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e4c3225e-4fc4-4b1a-b9fe-2f7ef517e17a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:23.461651 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e4c3225e-4fc4-4b1a-b9fe-2f7ef517e17a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:23.466782 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e4c3225e-4fc4-4b1a-b9fe-2f7ef517e17a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:23.470749 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e4c3225e-4fc4-4b1a-b9fe-2f7ef517e17a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:23.471231 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e4c3225e-4fc4-4b1a-b9fe-2f7ef517e17a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:24.301950 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e4c3225e-4fc4-4b1a-b9fe-2f7ef517e17a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:24.309077 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e790bb6b-3ac1-4b43-8108-8384a843b521 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:24.309077 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e790bb6b-3ac1-4b43-8108-8384a843b521 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:24.321093 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e4c3225e-4fc4-4b1a-b9fe-2f7ef517e17a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1218 microversion: 2.1 time: 0.883413 Nov 23 04:14:24.329085 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e790bb6b-3ac1-4b43-8108-8384a843b521 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:24.331999 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e790bb6b-3ac1-4b43-8108-8384a843b521 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:24.334415 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e790bb6b-3ac1-4b43-8108-8384a843b521 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:24.337006 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e790bb6b-3ac1-4b43-8108-8384a843b521 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:24.345914 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 12/26] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:23 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1218 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:24.476544 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e790bb6b-3ac1-4b43-8108-8384a843b521 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:24.484925 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e790bb6b-3ac1-4b43-8108-8384a843b521 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1270 microversion: 2.1 time: 0.182079 Nov 23 04:14:24.496316 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 15/27] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:24 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:25.342910 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e64dcfe1-d9d8-4be6-aaf1-ec5b250ebc2a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:25.343564 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e64dcfe1-d9d8-4be6-aaf1-ec5b250ebc2a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:25.360947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e64dcfe1-d9d8-4be6-aaf1-ec5b250ebc2a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:25.366076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e64dcfe1-d9d8-4be6-aaf1-ec5b250ebc2a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:25.366076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e64dcfe1-d9d8-4be6-aaf1-ec5b250ebc2a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:25.366076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e64dcfe1-d9d8-4be6-aaf1-ec5b250ebc2a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:25.466308 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e64dcfe1-d9d8-4be6-aaf1-ec5b250ebc2a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:25.482562 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e64dcfe1-d9d8-4be6-aaf1-ec5b250ebc2a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1210 microversion: 2.1 time: 0.145876 Nov 23 04:14:25.483522 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 16/28] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:25 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1210 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:25.513687 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-20a417df-ab5d-45c5-8ae7-32112802e877 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:25.514309 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-20a417df-ab5d-45c5-8ae7-32112802e877 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:25.530753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20a417df-ab5d-45c5-8ae7-32112802e877 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:25.531239 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20a417df-ab5d-45c5-8ae7-32112802e877 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:25.532038 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20a417df-ab5d-45c5-8ae7-32112802e877 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:25.532473 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20a417df-ab5d-45c5-8ae7-32112802e877 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:25.604734 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1f45d610-c22c-43b1-a295-38542ca382f5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'create', calling method: .version_select at 0x7fa7df51cd30>, body: {"keypair": {"name": "tempest-keypair-270007756"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:25.692831 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-1f45d610-c22c-43b1-a295-38542ca382f5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:14:25.705448 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-1f45d610-c22c-43b1-a295-38542ca382f5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for user 1009c9c7798f48f6ad891766711d0c0f and project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:14:25.731507 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-20a417df-ab5d-45c5-8ae7-32112802e877 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:25.740854 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-20a417df-ab5d-45c5-8ae7-32112802e877 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1278 microversion: 2.1 time: 0.231934 Nov 23 04:14:25.747685 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 17/29] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:25 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1278 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:26.503086 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-44efac4c-9ac1-48a5-b786-993d8dafc405 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:26.503898 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-44efac4c-9ac1-48a5-b786-993d8dafc405 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:26.520186 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44efac4c-9ac1-48a5-b786-993d8dafc405 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:26.521122 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-1f45d610-c22c-43b1-a295-38542ca382f5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:14:26.525943 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44efac4c-9ac1-48a5-b786-993d8dafc405 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:26.533047 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44efac4c-9ac1-48a5-b786-993d8dafc405 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:26.535683 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44efac4c-9ac1-48a5-b786-993d8dafc405 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:26.545776 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-1f45d610-c22c-43b1-a295-38542ca382f5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for user 1009c9c7798f48f6ad891766711d0c0f and project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:14:26.591931 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1f45d610-c22c-43b1-a295-38542ca382f5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.260739 Nov 23 04:14:26.595802 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 13/30] 10.222.0.54 () {62 vars in 1198 bytes} [Tue Nov 23 04:14:25 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1265 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 04:14:26.776693 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3730296a-7281-4664-829a-b4f1deab6d36 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:26.780230 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3730296a-7281-4664-829a-b4f1deab6d36 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:26.800685 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3730296a-7281-4664-829a-b4f1deab6d36 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:26.802025 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3730296a-7281-4664-829a-b4f1deab6d36 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:26.803409 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3730296a-7281-4664-829a-b4f1deab6d36 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:26.803950 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3730296a-7281-4664-829a-b4f1deab6d36 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:26.819044 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-44efac4c-9ac1-48a5-b786-993d8dafc405 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:26.845895 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-44efac4c-9ac1-48a5-b786-993d8dafc405 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1266 microversion: 2.1 time: 0.346686 Nov 23 04:14:26.854039 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 18/31] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:26 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:27.045526 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3730296a-7281-4664-829a-b4f1deab6d36 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:27.057598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3730296a-7281-4664-829a-b4f1deab6d36 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1276 microversion: 2.1 time: 0.290607 Nov 23 04:14:27.065394 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 14/32] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:26 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1276 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:27.872186 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-27f02124-7947-4020-a5bb-a616e4b48e3f tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:27.873084 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-27f02124-7947-4020-a5bb-a616e4b48e3f tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:27.884049 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-27f02124-7947-4020-a5bb-a616e4b48e3f tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:27.884513 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-27f02124-7947-4020-a5bb-a616e4b48e3f tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:27.893918 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-27f02124-7947-4020-a5bb-a616e4b48e3f tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:27.894447 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-27f02124-7947-4020-a5bb-a616e4b48e3f tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:28.086309 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-548a071e-207d-4689-ab6c-24034b828535 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:28.087553 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-548a071e-207d-4689-ab6c-24034b828535 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:28.112927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-548a071e-207d-4689-ab6c-24034b828535 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:28.113382 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-548a071e-207d-4689-ab6c-24034b828535 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:28.125150 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-548a071e-207d-4689-ab6c-24034b828535 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:28.129594 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-548a071e-207d-4689-ab6c-24034b828535 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:28.170475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-27f02124-7947-4020-a5bb-a616e4b48e3f tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:28.213593 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-27f02124-7947-4020-a5bb-a616e4b48e3f tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1272 microversion: 2.1 time: 0.331061 Nov 23 04:14:28.231607 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 19/33] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:27 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1272 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:28.441268 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-548a071e-207d-4689-ab6c-24034b828535 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:28.450731 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-548a071e-207d-4689-ab6c-24034b828535 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1276 microversion: 2.1 time: 0.370935 Nov 23 04:14:28.461128 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 15/34] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:28 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1276 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:29.233914 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1258cc24-c43f-40a3-89d7-c4a99552a9cb tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:29.234529 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1258cc24-c43f-40a3-89d7-c4a99552a9cb tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:29.267845 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1258cc24-c43f-40a3-89d7-c4a99552a9cb tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:29.268345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1258cc24-c43f-40a3-89d7-c4a99552a9cb tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:29.269190 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1258cc24-c43f-40a3-89d7-c4a99552a9cb tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:29.280231 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1258cc24-c43f-40a3-89d7-c4a99552a9cb tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:29.510187 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ad286b63-75b0-4946-89e5-18ac4062418d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:29.514439 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ad286b63-75b0-4946-89e5-18ac4062418d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:29.561095 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad286b63-75b0-4946-89e5-18ac4062418d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:29.561560 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad286b63-75b0-4946-89e5-18ac4062418d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:29.562599 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad286b63-75b0-4946-89e5-18ac4062418d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:29.563406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad286b63-75b0-4946-89e5-18ac4062418d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:29.601189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1258cc24-c43f-40a3-89d7-c4a99552a9cb tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:29.616530 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1258cc24-c43f-40a3-89d7-c4a99552a9cb tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1272 microversion: 2.1 time: 0.386466 Nov 23 04:14:29.623982 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 20/35] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:29 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1272 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:30.216930 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ad286b63-75b0-4946-89e5-18ac4062418d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:30.234102 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ad286b63-75b0-4946-89e5-18ac4062418d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.755904 Nov 23 04:14:30.241406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 16/36] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:29 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:30.642170 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-38f76cc4-b470-499e-b106-48b9e0aab53a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:30.642834 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-38f76cc4-b470-499e-b106-48b9e0aab53a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:30.653029 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-38f76cc4-b470-499e-b106-48b9e0aab53a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:30.659921 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-38f76cc4-b470-499e-b106-48b9e0aab53a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:30.667104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-38f76cc4-b470-499e-b106-48b9e0aab53a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:30.667104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-38f76cc4-b470-499e-b106-48b9e0aab53a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:31.251424 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1a0772d9-9700-4098-a266-be4f5b697583 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:31.252604 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1a0772d9-9700-4098-a266-be4f5b697583 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:31.283036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a0772d9-9700-4098-a266-be4f5b697583 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:31.292637 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a0772d9-9700-4098-a266-be4f5b697583 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:31.294342 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a0772d9-9700-4098-a266-be4f5b697583 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:31.294883 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a0772d9-9700-4098-a266-be4f5b697583 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:31.655680 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-38f76cc4-b470-499e-b106-48b9e0aab53a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:31.664828 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-38f76cc4-b470-499e-b106-48b9e0aab53a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 1.026146 Nov 23 04:14:31.682177 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 21/37] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:30 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:32.061740 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1a0772d9-9700-4098-a266-be4f5b697583 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:32.080824 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1a0772d9-9700-4098-a266-be4f5b697583 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.833181 Nov 23 04:14:32.091614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 17/38] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:31 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:32.392451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-785447234", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef6d53c7-2a63-45b6-aaed-257052cde1c8"}]}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:32.453683 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.network.neutron [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] validate_networks() for [('ef6d53c7-2a63-45b6-aaed-257052cde1c8', None, None, None, None, None)] {{(pid=116837) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:14:32.687607 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a1be3217-bc46-4b98-a55c-93fd5ec98f6e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:32.688225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a1be3217-bc46-4b98-a55c-93fd5ec98f6e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:32.697032 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1be3217-bc46-4b98-a55c-93fd5ec98f6e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:32.701628 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1be3217-bc46-4b98-a55c-93fd5ec98f6e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:32.703856 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1be3217-bc46-4b98-a55c-93fd5ec98f6e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:32.704347 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1be3217-bc46-4b98-a55c-93fd5ec98f6e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:33.574004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a1be3217-bc46-4b98-a55c-93fd5ec98f6e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:33.589883 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a1be3217-bc46-4b98-a55c-93fd5ec98f6e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.903940 Nov 23 04:14:33.600918 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 18/39] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:32 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:33.609316 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d9938a6c-8dd3-4bb2-974a-0a54e69a8aa7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:33.610383 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d9938a6c-8dd3-4bb2-974a-0a54e69a8aa7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:33.618201 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d9938a6c-8dd3-4bb2-974a-0a54e69a8aa7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:33.618972 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d9938a6c-8dd3-4bb2-974a-0a54e69a8aa7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:33.619984 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d9938a6c-8dd3-4bb2-974a-0a54e69a8aa7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:33.620842 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d9938a6c-8dd3-4bb2-974a-0a54e69a8aa7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:34.013135 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Flavor limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:14:34.016270 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Image limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:14:34.017822 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Flavor pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:14:34.018306 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Image pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:14:34.020598 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:14:34.039873 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:34.041946 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:34.044174 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:34.045020 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:34.073655 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Getting quotas for project 79d1a358755a4113b0a35cf50d3cc95a. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:14:34.080323 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Getting quotas for user 9477961ce0bc4164be46f0a54a309d7c and project 79d1a358755a4113b0a35cf50d3cc95a. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:14:34.101908 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Going to run 1 instances... {{(pid=116837) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:14:34.104478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:14:34.307151 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d9938a6c-8dd3-4bb2-974a-0a54e69a8aa7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:34.312357 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d9938a6c-8dd3-4bb2-974a-0a54e69a8aa7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.703850 Nov 23 04:14:34.314062 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 19/40] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:33 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:34.659842 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-25717586-9cab-4217-87b4-abcb1896caab req-01f88056-b909-4d3b-8948-46cf21e75d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87273409-979f-4dd3-b901-60f00ba87d4c", "tag": "832e3d40-1fef-4a95-9553-b2e7c02d57af"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:34.662335 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:14:34.662335 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:14:34.681694 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-25717586-9cab-4217-87b4-abcb1896caab req-01f88056-b909-4d3b-8948-46cf21e75d50 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:34.690838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-25717586-9cab-4217-87b4-abcb1896caab req-01f88056-b909-4d3b-8948-46cf21e75d50 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:34.714709 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-25717586-9cab-4217-87b4-abcb1896caab req-01f88056-b909-4d3b-8948-46cf21e75d50 service nova] Creating event network-changed:832e3d40-1fef-4a95-9553-b2e7c02d57af for instance 87273409-979f-4dd3-b901-60f00ba87d4c on hv-cinder-76845 Nov 23 04:14:34.716065 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-25717586-9cab-4217-87b4-abcb1896caab req-01f88056-b909-4d3b-8948-46cf21e75d50 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116836) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 04:14:34.717369 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9fe445c1-b3b7-4184-86c0-e949a9487c80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:34.717972 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9fe445c1-b3b7-4184-86c0-e949a9487c80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:34.718936 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9fe445c1-b3b7-4184-86c0-e949a9487c80 None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:34.719578 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9fe445c1-b3b7-4184-86c0-e949a9487c80 None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:34.731355 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.compute.rpcapi [None req-9fe445c1-b3b7-4184-86c0-e949a9487c80 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 23 04:14:34.732563 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9fe445c1-b3b7-4184-86c0-e949a9487c80 None None] Releasing lock "compute-rpcapi-router" {{(pid=116836) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 04:14:34.772165 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9fe445c1-b3b7-4184-86c0-e949a9487c80 None None] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200670 Nov 23 04:14:34.776030 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 20/41] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:14:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:14:34.839126 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f63320a1-a252-4fa1-af71-47d0a0e1d1f0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.967925 Nov 23 04:14:34.839126 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 22/42] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:14:31 2021] POST /compute/v2.1/servers => generated 383 bytes in 2970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:14:34.844734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8503d96a-c908-4316-829e-7793231f9f3e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:34.845365 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8503d96a-c908-4316-829e-7793231f9f3e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:34.856798 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-70f41eaa-71d3-4037-97c4-60dacf0dda7f req-aca99fbe-6de7-4734-91a2-a299cbc52eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e50b4e8-8b55-4abf-b356-7e130ff4c5a5", "tag": "5802ea66-681d-4f76-a561-6e2e0d2de725"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:34.858822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:14:34.858822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:14:34.862316 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8503d96a-c908-4316-829e-7793231f9f3e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:34.863493 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8503d96a-c908-4316-829e-7793231f9f3e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:34.864336 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8503d96a-c908-4316-829e-7793231f9f3e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:34.864785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8503d96a-c908-4316-829e-7793231f9f3e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:34.871123 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-70f41eaa-71d3-4037-97c4-60dacf0dda7f req-aca99fbe-6de7-4734-91a2-a299cbc52eb9 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:34.874182 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-70f41eaa-71d3-4037-97c4-60dacf0dda7f req-aca99fbe-6de7-4734-91a2-a299cbc52eb9 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:34.887504 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-70f41eaa-71d3-4037-97c4-60dacf0dda7f req-aca99fbe-6de7-4734-91a2-a299cbc52eb9 service nova] Creating event network-changed:5802ea66-681d-4f76-a561-6e2e0d2de725 for instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 on hv-cinder-76845 Nov 23 04:14:34.919712 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-70f41eaa-71d3-4037-97c4-60dacf0dda7f req-aca99fbe-6de7-4734-91a2-a299cbc52eb9 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115507 Nov 23 04:14:34.924213 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 21/43] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:14:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:34.933456 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-32e841f7-8037-48fd-81e8-4e03ec6f86e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:34.957806 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-32e841f7-8037-48fd-81e8-4e03ec6f86e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:35.176419 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-32e841f7-8037-48fd-81e8-4e03ec6f86e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:35.176419 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-32e841f7-8037-48fd-81e8-4e03ec6f86e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1221 microversion: 2.1 time: 0.216357 Nov 23 04:14:35.176419 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 22/44] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:34 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1221 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:35.305058 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8503d96a-c908-4316-829e-7793231f9f3e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:35.330242 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2bd4f439-573b-42f1-93b6-25d32b729806 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:35.330854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2bd4f439-573b-42f1-93b6-25d32b729806 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:35.335159 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8503d96a-c908-4316-829e-7793231f9f3e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.500432 Nov 23 04:14:35.335988 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 23/45] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:34 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:35.356722 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2bd4f439-573b-42f1-93b6-25d32b729806 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:35.357324 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2bd4f439-573b-42f1-93b6-25d32b729806 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:35.358179 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2bd4f439-573b-42f1-93b6-25d32b729806 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:35.358612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2bd4f439-573b-42f1-93b6-25d32b729806 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:35.962568 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2132481354", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef6d53c7-2a63-45b6-aaed-257052cde1c8"}]}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:36.136488 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.network.neutron [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] validate_networks() for [('ef6d53c7-2a63-45b6-aaed-257052cde1c8', None, None, None, None, None)] {{(pid=116837) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:14:36.410973 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2bd4f439-573b-42f1-93b6-25d32b729806 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:36.424864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2bd4f439-573b-42f1-93b6-25d32b729806 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 1.098105 Nov 23 04:14:36.439545 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 23/46] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:35 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:36.454690 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ab8db81e-aab8-4d07-b56f-dd3a8ce8032c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:36.457048 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ab8db81e-aab8-4d07-b56f-dd3a8ce8032c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:36.484551 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ab8db81e-aab8-4d07-b56f-dd3a8ce8032c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:36.485485 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ab8db81e-aab8-4d07-b56f-dd3a8ce8032c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:36.487773 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ab8db81e-aab8-4d07-b56f-dd3a8ce8032c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:36.488293 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ab8db81e-aab8-4d07-b56f-dd3a8ce8032c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:37.129248 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ab8db81e-aab8-4d07-b56f-dd3a8ce8032c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:37.137363 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ab8db81e-aab8-4d07-b56f-dd3a8ce8032c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.699962 Nov 23 04:14:37.142415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 24/47] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:36 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:37.452740 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dddcc372-877f-47c3-9d1d-cb66f7d87a2d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:37.453862 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dddcc372-877f-47c3-9d1d-cb66f7d87a2d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:37.463066 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dddcc372-877f-47c3-9d1d-cb66f7d87a2d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:37.479796 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dddcc372-877f-47c3-9d1d-cb66f7d87a2d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:37.481686 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dddcc372-877f-47c3-9d1d-cb66f7d87a2d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:37.482608 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dddcc372-877f-47c3-9d1d-cb66f7d87a2d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:37.884539 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Flavor limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:14:37.885117 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Image limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:14:37.885429 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Flavor pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:14:37.886252 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Image pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:14:37.886676 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:14:37.906024 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dddcc372-877f-47c3-9d1d-cb66f7d87a2d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:37.918023 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:37.918681 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:37.922519 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:37.922989 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:37.942431 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dddcc372-877f-47c3-9d1d-cb66f7d87a2d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.494627 Nov 23 04:14:37.947410 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 25/48] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:37 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:37.959739 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-174553646", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fca30bf0-6b8e-488c-ba53-d9bc0d901c60"}], "security_groups": [{"name": "tempest-securitygroup--7181194"}], "key_name": "tempest-keypair-270007756", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:37.971120 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Getting quotas for project 79d1a358755a4113b0a35cf50d3cc95a. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:14:37.982404 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Getting quotas for user 9477961ce0bc4164be46f0a54a309d7c and project 79d1a358755a4113b0a35cf50d3cc95a. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:14:38.016041 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Going to run 1 instances... {{(pid=116837) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:14:38.021006 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:14:38.208525 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] validate_networks() for [('fca30bf0-6b8e-488c-ba53-d9bc0d901c60', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:14:38.688195 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:14:38.688955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:14:38.689639 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:14:38.690057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:14:38.690476 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:14:38.702112 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:38.702800 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:38.703753 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:38.704259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:38.722603 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:14:38.727161 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for user 1009c9c7798f48f6ad891766711d0c0f and project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:14:38.740088 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:14:38.742687 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:14:38.808029 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2f1eae40-5772-4070-8381-533c65b7e3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.850302 Nov 23 04:14:38.822049 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 24/49] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:14:35 2021] POST /compute/v2.1/servers => generated 383 bytes in 2865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 04:14:38.837702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6b023fd0-8aca-448c-8afb-ed64770c8d91 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:38.845274 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6b023fd0-8aca-448c-8afb-ed64770c8d91 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:38.861460 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b023fd0-8aca-448c-8afb-ed64770c8d91 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:38.861909 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b023fd0-8aca-448c-8afb-ed64770c8d91 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:38.862771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b023fd0-8aca-448c-8afb-ed64770c8d91 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:38.863238 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b023fd0-8aca-448c-8afb-ed64770c8d91 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:38.930897 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dfa459a8-1f22-4813-80ad-f83215381283 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.986287 Nov 23 04:14:38.932006 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 26/50] 10.222.0.54 () {62 vars in 1187 bytes} [Tue Nov 23 04:14:37 2021] POST /compute/v2.1/servers => generated 399 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 04:14:38.944173 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9e7ddbdc-7b3b-4d66-b9dd-2cb7cd561705 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:38.945960 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9e7ddbdc-7b3b-4d66-b9dd-2cb7cd561705 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:39.196097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9e7ddbdc-7b3b-4d66-b9dd-2cb7cd561705 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:39.204538 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9e7ddbdc-7b3b-4d66-b9dd-2cb7cd561705 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1222 microversion: 2.1 time: 0.269740 Nov 23 04:14:39.208728 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 27/51] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:38 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1222 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:39.224024 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8a5c5820-3214-4265-b70d-6065b72f844a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:39.239910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8a5c5820-3214-4265-b70d-6065b72f844a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:39.278198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6b023fd0-8aca-448c-8afb-ed64770c8d91 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:39.288023 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6b023fd0-8aca-448c-8afb-ed64770c8d91 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.454789 Nov 23 04:14:39.288933 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 25/52] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:38 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:39.302246 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8a5c5820-3214-4265-b70d-6065b72f844a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:39.303640 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4f0fa589-99bd-43fe-ae20-dda90ec38cc7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:39.305120 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4f0fa589-99bd-43fe-ae20-dda90ec38cc7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:39.312909 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8a5c5820-3214-4265-b70d-6065b72f844a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:39.314762 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8a5c5820-3214-4265-b70d-6065b72f844a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:39.316827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8a5c5820-3214-4265-b70d-6065b72f844a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1280 microversion: 2.20 time: 0.105245 Nov 23 04:14:39.318079 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4f0fa589-99bd-43fe-ae20-dda90ec38cc7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:39.320392 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4f0fa589-99bd-43fe-ae20-dda90ec38cc7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:39.322879 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4f0fa589-99bd-43fe-ae20-dda90ec38cc7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:39.325204 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 28/53] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:39 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:39.327775 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4f0fa589-99bd-43fe-ae20-dda90ec38cc7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:39.494736 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4f0fa589-99bd-43fe-ae20-dda90ec38cc7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:39.502695 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4f0fa589-99bd-43fe-ae20-dda90ec38cc7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.211644 Nov 23 04:14:39.503288 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 26/54] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:39 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:40.228468 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c81d032e-10e0-4aef-80f0-033ba011f1f9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:40.229082 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c81d032e-10e0-4aef-80f0-033ba011f1f9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:40.306225 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a113f17f-a679-4ec5-b3a5-e82bcf6e4756 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:40.308512 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a113f17f-a679-4ec5-b3a5-e82bcf6e4756 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:40.319740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a113f17f-a679-4ec5-b3a5-e82bcf6e4756 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:40.321600 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a113f17f-a679-4ec5-b3a5-e82bcf6e4756 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:40.323708 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a113f17f-a679-4ec5-b3a5-e82bcf6e4756 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:40.324204 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a113f17f-a679-4ec5-b3a5-e82bcf6e4756 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:40.330316 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c81d032e-10e0-4aef-80f0-033ba011f1f9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:40.338090 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c81d032e-10e0-4aef-80f0-033ba011f1f9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1222 microversion: 2.1 time: 0.113421 Nov 23 04:14:40.345140 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 29/55] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:40 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:40.355584 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-29fdaaea-bd99-445b-89b0-3014f18490b1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:40.356884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-29fdaaea-bd99-445b-89b0-3014f18490b1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:40.448984 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-29fdaaea-bd99-445b-89b0-3014f18490b1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:40.457220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-29fdaaea-bd99-445b-89b0-3014f18490b1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:40.468326 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-29fdaaea-bd99-445b-89b0-3014f18490b1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:40.468326 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-29fdaaea-bd99-445b-89b0-3014f18490b1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1280 microversion: 2.20 time: 0.114364 Nov 23 04:14:40.468326 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 30/56] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:40 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:40.519835 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4f7f87c4-9665-49e6-bea1-f57b59ab1869 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:40.551614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4f7f87c4-9665-49e6-bea1-f57b59ab1869 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:40.551614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f7f87c4-9665-49e6-bea1-f57b59ab1869 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:40.551614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f7f87c4-9665-49e6-bea1-f57b59ab1869 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:40.551614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f7f87c4-9665-49e6-bea1-f57b59ab1869 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:40.551915 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f7f87c4-9665-49e6-bea1-f57b59ab1869 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:40.551991 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a113f17f-a679-4ec5-b3a5-e82bcf6e4756 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:40.551991 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a113f17f-a679-4ec5-b3a5-e82bcf6e4756 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.244120 Nov 23 04:14:40.551991 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 27/57] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:40 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:40.664410 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4f7f87c4-9665-49e6-bea1-f57b59ab1869 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:40.673353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4f7f87c4-9665-49e6-bea1-f57b59ab1869 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.157074 Nov 23 04:14:40.673923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 31/58] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:40 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:41.358461 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ef173d12-ead8-4490-aba5-1351d425c59f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:41.359773 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ef173d12-ead8-4490-aba5-1351d425c59f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:41.367106 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ef173d12-ead8-4490-aba5-1351d425c59f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:41.367608 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ef173d12-ead8-4490-aba5-1351d425c59f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:41.368576 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ef173d12-ead8-4490-aba5-1351d425c59f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:41.369165 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ef173d12-ead8-4490-aba5-1351d425c59f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:41.486268 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-98e50a9d-97d6-4052-b42f-29e00e7642d5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:41.489036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-98e50a9d-97d6-4052-b42f-29e00e7642d5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:41.507353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-98e50a9d-97d6-4052-b42f-29e00e7642d5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:41.511572 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-98e50a9d-97d6-4052-b42f-29e00e7642d5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:41.512590 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-98e50a9d-97d6-4052-b42f-29e00e7642d5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:41.513026 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-98e50a9d-97d6-4052-b42f-29e00e7642d5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:41.669628 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ef173d12-ead8-4490-aba5-1351d425c59f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:41.675635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-98e50a9d-97d6-4052-b42f-29e00e7642d5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:41.677642 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ef173d12-ead8-4490-aba5-1351d425c59f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1226 microversion: 2.1 time: 0.323562 Nov 23 04:14:41.678334 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 28/59] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:41 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1226 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:41.683389 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ff163a3f-101b-4943-b892-451ab5f4c990 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:41.684740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ff163a3f-101b-4943-b892-451ab5f4c990 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:41.692039 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff163a3f-101b-4943-b892-451ab5f4c990 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:41.692614 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff163a3f-101b-4943-b892-451ab5f4c990 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:41.693569 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff163a3f-101b-4943-b892-451ab5f4c990 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:41.694075 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff163a3f-101b-4943-b892-451ab5f4c990 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:41.700952 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-98e50a9d-97d6-4052-b42f-29e00e7642d5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:41.702568 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-98e50a9d-97d6-4052-b42f-29e00e7642d5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:41.703794 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-98e50a9d-97d6-4052-b42f-29e00e7642d5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1284 microversion: 2.20 time: 0.228322 Nov 23 04:14:41.704467 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 32/60] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:41 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:41.708969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e68b4608-52a9-4006-87c1-9effd623e292 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:41.709832 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e68b4608-52a9-4006-87c1-9effd623e292 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:41.716998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e68b4608-52a9-4006-87c1-9effd623e292 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:41.717782 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e68b4608-52a9-4006-87c1-9effd623e292 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:41.718798 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e68b4608-52a9-4006-87c1-9effd623e292 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:41.719487 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e68b4608-52a9-4006-87c1-9effd623e292 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:42.084757 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ff163a3f-101b-4943-b892-451ab5f4c990 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:42.102425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ff163a3f-101b-4943-b892-451ab5f4c990 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.422817 Nov 23 04:14:42.104674 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 29/61] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:41 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:42.132235 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e68b4608-52a9-4006-87c1-9effd623e292 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:42.140378 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e68b4608-52a9-4006-87c1-9effd623e292 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.434714 Nov 23 04:14:42.141152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 33/62] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:41 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:42.702752 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-cc6c2cdb-bbf6-4ca6-943f-8faf479e6345 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:42.704999 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-cc6c2cdb-bbf6-4ca6-943f-8faf479e6345 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:42.721964 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e8590a90-6f6e-42b1-87a6-359a885a0cb0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:42.722586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e8590a90-6f6e-42b1-87a6-359a885a0cb0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:42.750651 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8590a90-6f6e-42b1-87a6-359a885a0cb0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:42.753108 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8590a90-6f6e-42b1-87a6-359a885a0cb0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:42.753108 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8590a90-6f6e-42b1-87a6-359a885a0cb0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:42.753108 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8590a90-6f6e-42b1-87a6-359a885a0cb0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:42.758345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc6c2cdb-bbf6-4ca6-943f-8faf479e6345 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:42.760352 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc6c2cdb-bbf6-4ca6-943f-8faf479e6345 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:42.769486 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc6c2cdb-bbf6-4ca6-943f-8faf479e6345 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:42.776192 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc6c2cdb-bbf6-4ca6-943f-8faf479e6345 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:42.902709 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e8590a90-6f6e-42b1-87a6-359a885a0cb0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:42.912089 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e8590a90-6f6e-42b1-87a6-359a885a0cb0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:42.913682 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e8590a90-6f6e-42b1-87a6-359a885a0cb0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:42.914927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e8590a90-6f6e-42b1-87a6-359a885a0cb0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1276 microversion: 2.20 time: 0.196663 Nov 23 04:14:42.915938 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 34/63] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:42 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:14:42.936792 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-cc6c2cdb-bbf6-4ca6-943f-8faf479e6345 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:42.952667 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-cc6c2cdb-bbf6-4ca6-943f-8faf479e6345 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1274 microversion: 2.1 time: 0.257755 Nov 23 04:14:42.954825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 30/64] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:42 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1274 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:43.120836 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-acfdf983-7f80-4339-9d90-95ddfbdd28b2 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:43.122009 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-acfdf983-7f80-4339-9d90-95ddfbdd28b2 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:43.129091 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acfdf983-7f80-4339-9d90-95ddfbdd28b2 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:43.129862 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acfdf983-7f80-4339-9d90-95ddfbdd28b2 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:43.130831 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acfdf983-7f80-4339-9d90-95ddfbdd28b2 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:43.131441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acfdf983-7f80-4339-9d90-95ddfbdd28b2 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:43.160491 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-59e3d876-702c-4b54-9883-7633eb4a397e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:43.162670 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-59e3d876-702c-4b54-9883-7633eb4a397e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:43.174743 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-59e3d876-702c-4b54-9883-7633eb4a397e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:43.175307 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-59e3d876-702c-4b54-9883-7633eb4a397e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:43.182140 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-59e3d876-702c-4b54-9883-7633eb4a397e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:43.183157 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-59e3d876-702c-4b54-9883-7633eb4a397e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:43.588946 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-acfdf983-7f80-4339-9d90-95ddfbdd28b2 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:43.597358 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-acfdf983-7f80-4339-9d90-95ddfbdd28b2 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.480056 Nov 23 04:14:43.598688 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 35/65] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:43 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:43.765746 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-59e3d876-702c-4b54-9883-7633eb4a397e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:43.779556 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-59e3d876-702c-4b54-9883-7633eb4a397e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.622152 Nov 23 04:14:43.783854 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 31/66] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:43 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:43.936612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5f5d969a-4bb3-4f55-a16e-201dd2e5fc99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:43.937248 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5f5d969a-4bb3-4f55-a16e-201dd2e5fc99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:43.945317 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f5d969a-4bb3-4f55-a16e-201dd2e5fc99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:43.945761 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f5d969a-4bb3-4f55-a16e-201dd2e5fc99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:43.951468 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f5d969a-4bb3-4f55-a16e-201dd2e5fc99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:43.952098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f5d969a-4bb3-4f55-a16e-201dd2e5fc99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:43.972966 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c367f325-fedc-41cf-8a5b-9814b5eac7e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:43.973602 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c367f325-fedc-41cf-8a5b-9814b5eac7e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:43.982395 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c367f325-fedc-41cf-8a5b-9814b5eac7e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:43.982873 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c367f325-fedc-41cf-8a5b-9814b5eac7e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:43.983744 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c367f325-fedc-41cf-8a5b-9814b5eac7e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:43.984208 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c367f325-fedc-41cf-8a5b-9814b5eac7e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:44.174468 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5f5d969a-4bb3-4f55-a16e-201dd2e5fc99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:44.179692 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c367f325-fedc-41cf-8a5b-9814b5eac7e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:44.185478 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5f5d969a-4bb3-4f55-a16e-201dd2e5fc99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:44.188163 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5f5d969a-4bb3-4f55-a16e-201dd2e5fc99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:44.189510 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5f5d969a-4bb3-4f55-a16e-201dd2e5fc99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1340 microversion: 2.20 time: 0.257691 Nov 23 04:14:44.201684 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c367f325-fedc-41cf-8a5b-9814b5eac7e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1280 microversion: 2.1 time: 0.224783 Nov 23 04:14:44.201684 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 32/67] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:43 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1280 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:44.202389 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 36/68] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:43 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1340 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:44.614526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-384f1013-87c7-4e78-b027-5eaa68f449cd tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:44.617588 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-384f1013-87c7-4e78-b027-5eaa68f449cd tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:44.630774 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-384f1013-87c7-4e78-b027-5eaa68f449cd tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:44.633396 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-384f1013-87c7-4e78-b027-5eaa68f449cd tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:44.635596 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-384f1013-87c7-4e78-b027-5eaa68f449cd tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:44.637626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-384f1013-87c7-4e78-b027-5eaa68f449cd tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:44.806691 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bcf72708-1009-4b4c-b9e0-505fb0717e2f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:44.809507 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bcf72708-1009-4b4c-b9e0-505fb0717e2f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:44.826105 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bcf72708-1009-4b4c-b9e0-505fb0717e2f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:44.826489 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bcf72708-1009-4b4c-b9e0-505fb0717e2f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:44.827337 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bcf72708-1009-4b4c-b9e0-505fb0717e2f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:44.827779 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bcf72708-1009-4b4c-b9e0-505fb0717e2f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:45.135561 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-384f1013-87c7-4e78-b027-5eaa68f449cd tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:45.171122 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-384f1013-87c7-4e78-b027-5eaa68f449cd tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.560113 Nov 23 04:14:45.182393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 33/69] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:44 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:45.189170 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-60ac67e4-6ace-4860-a52b-3d12cbae9f24 req-43b2ce01-910f-4cf8-addd-07ddf8c8a277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696e3da2-6fdb-4741-8f4f-fffccaf8d403", "tag": "f48f6a3d-794b-4b20-922c-ac55129a50c5"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:45.192139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:14:45.192139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:14:45.206733 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-60ac67e4-6ace-4860-a52b-3d12cbae9f24 req-43b2ce01-910f-4cf8-addd-07ddf8c8a277 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:45.207737 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-60ac67e4-6ace-4860-a52b-3d12cbae9f24 req-43b2ce01-910f-4cf8-addd-07ddf8c8a277 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:45.234358 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-60ac67e4-6ace-4860-a52b-3d12cbae9f24 req-43b2ce01-910f-4cf8-addd-07ddf8c8a277 service nova] Creating event network-changed:f48f6a3d-794b-4b20-922c-ac55129a50c5 for instance 696e3da2-6fdb-4741-8f4f-fffccaf8d403 on hv-cinder-76845 Nov 23 04:14:45.235852 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-60ac67e4-6ace-4860-a52b-3d12cbae9f24 req-43b2ce01-910f-4cf8-addd-07ddf8c8a277 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116837) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 23 04:14:45.237418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9edabdd3-abb4-4601-b034-4eaddfc2b754 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:45.238007 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9edabdd3-abb4-4601-b034-4eaddfc2b754 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:45.238961 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9edabdd3-abb4-4601-b034-4eaddfc2b754 None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:45.239572 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9edabdd3-abb4-4601-b034-4eaddfc2b754 None None] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:45.251175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.compute.rpcapi [None req-9edabdd3-abb4-4601-b034-4eaddfc2b754 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 23 04:14:45.252086 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9edabdd3-abb4-4601-b034-4eaddfc2b754 None None] Releasing lock "compute-rpcapi-router" {{(pid=116837) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 23 04:14:45.293442 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9edabdd3-abb4-4601-b034-4eaddfc2b754 None None] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114657 Nov 23 04:14:45.294381 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 34/70] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:14:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:45.296472 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-bcf72708-1009-4b4c-b9e0-505fb0717e2f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:45.303516 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-80098292-0b84-471f-a3fc-7057887b4679 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:45.304771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-80098292-0b84-471f-a3fc-7057887b4679 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:45.306220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bcf72708-1009-4b4c-b9e0-505fb0717e2f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.512335 Nov 23 04:14:45.311031 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 37/71] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:44 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:45.312559 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-80098292-0b84-471f-a3fc-7057887b4679 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:45.313205 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-80098292-0b84-471f-a3fc-7057887b4679 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:45.314475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-80098292-0b84-471f-a3fc-7057887b4679 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:45.315066 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-80098292-0b84-471f-a3fc-7057887b4679 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:45.322390 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e1113348-5a22-4cdc-8ebf-ce571ab61415 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:45.327676 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e1113348-5a22-4cdc-8ebf-ce571ab61415 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:45.341889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e1113348-5a22-4cdc-8ebf-ce571ab61415 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:45.342622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e1113348-5a22-4cdc-8ebf-ce571ab61415 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:45.345293 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e1113348-5a22-4cdc-8ebf-ce571ab61415 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:45.346507 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e1113348-5a22-4cdc-8ebf-ce571ab61415 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:45.689827 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-80098292-0b84-471f-a3fc-7057887b4679 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:45.702554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-80098292-0b84-471f-a3fc-7057887b4679 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:45.704306 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-80098292-0b84-471f-a3fc-7057887b4679 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:45.705446 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-80098292-0b84-471f-a3fc-7057887b4679 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1338 microversion: 2.20 time: 0.408995 Nov 23 04:14:45.720181 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 35/72] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:45 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1338 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:45.938877 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e1113348-5a22-4cdc-8ebf-ce571ab61415 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:45.948308 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e1113348-5a22-4cdc-8ebf-ce571ab61415 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.635062 Nov 23 04:14:45.948734 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 38/73] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:45 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:46.189337 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-57f8f7f3-75d8-4b9d-a401-3f99b1d550d5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:46.189987 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-57f8f7f3-75d8-4b9d-a401-3f99b1d550d5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:46.196136 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-57f8f7f3-75d8-4b9d-a401-3f99b1d550d5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:46.196581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-57f8f7f3-75d8-4b9d-a401-3f99b1d550d5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:46.197355 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-57f8f7f3-75d8-4b9d-a401-3f99b1d550d5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:46.197813 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-57f8f7f3-75d8-4b9d-a401-3f99b1d550d5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:46.334219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9ac5ffe5-7a1d-40a8-8b0a-e6765a2723a8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:46.335685 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9ac5ffe5-7a1d-40a8-8b0a-e6765a2723a8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:46.350637 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9ac5ffe5-7a1d-40a8-8b0a-e6765a2723a8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:46.352148 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9ac5ffe5-7a1d-40a8-8b0a-e6765a2723a8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:46.354083 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9ac5ffe5-7a1d-40a8-8b0a-e6765a2723a8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:46.354695 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9ac5ffe5-7a1d-40a8-8b0a-e6765a2723a8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:46.863299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-57f8f7f3-75d8-4b9d-a401-3f99b1d550d5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:46.877668 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-57f8f7f3-75d8-4b9d-a401-3f99b1d550d5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.689384 Nov 23 04:14:46.878977 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 36/74] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:46 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:46.889123 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-19b9fec5-af29-46d1-86ec-0509cc229d2d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:46.890551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-19b9fec5-af29-46d1-86ec-0509cc229d2d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:46.916611 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9ac5ffe5-7a1d-40a8-8b0a-e6765a2723a8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:46.920131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-19b9fec5-af29-46d1-86ec-0509cc229d2d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:46.920586 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-19b9fec5-af29-46d1-86ec-0509cc229d2d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:46.924672 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9ac5ffe5-7a1d-40a8-8b0a-e6765a2723a8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.600835 Nov 23 04:14:46.930395 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-19b9fec5-af29-46d1-86ec-0509cc229d2d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:46.930529 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 39/75] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:46 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:46.939257 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-19b9fec5-af29-46d1-86ec-0509cc229d2d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:46.965936 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e6a2eac3-3bbe-4022-b52c-82bd033d04e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:46.977927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e6a2eac3-3bbe-4022-b52c-82bd033d04e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:46.980939 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6a2eac3-3bbe-4022-b52c-82bd033d04e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:46.981885 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6a2eac3-3bbe-4022-b52c-82bd033d04e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:46.983424 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6a2eac3-3bbe-4022-b52c-82bd033d04e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:46.984043 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6a2eac3-3bbe-4022-b52c-82bd033d04e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:47.454870 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e6a2eac3-3bbe-4022-b52c-82bd033d04e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:47.460928 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-19b9fec5-af29-46d1-86ec-0509cc229d2d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:47.467575 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e6a2eac3-3bbe-4022-b52c-82bd033d04e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.505832 Nov 23 04:14:47.469531 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 40/76] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:46 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:47.472031 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-19b9fec5-af29-46d1-86ec-0509cc229d2d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:47.473947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-19b9fec5-af29-46d1-86ec-0509cc229d2d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:47.475673 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-19b9fec5-af29-46d1-86ec-0509cc229d2d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.595291 Nov 23 04:14:47.486865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 37/77] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:46 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:47.897746 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2672e0b0-2606-4644-94ba-0b7f45986575 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:47.898748 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2672e0b0-2606-4644-94ba-0b7f45986575 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:47.909337 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2672e0b0-2606-4644-94ba-0b7f45986575 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:47.910661 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2672e0b0-2606-4644-94ba-0b7f45986575 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:47.911696 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2672e0b0-2606-4644-94ba-0b7f45986575 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:47.912385 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2672e0b0-2606-4644-94ba-0b7f45986575 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:47.946412 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-744a3252-d71b-4c81-be37-1a04ba810f48 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:47.947517 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-744a3252-d71b-4c81-be37-1a04ba810f48 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:47.955736 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-744a3252-d71b-4c81-be37-1a04ba810f48 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:47.956505 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-744a3252-d71b-4c81-be37-1a04ba810f48 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:47.957877 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-744a3252-d71b-4c81-be37-1a04ba810f48 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:47.958700 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-744a3252-d71b-4c81-be37-1a04ba810f48 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:48.365299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-744a3252-d71b-4c81-be37-1a04ba810f48 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:48.368512 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2672e0b0-2606-4644-94ba-0b7f45986575 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:48.375409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-744a3252-d71b-4c81-be37-1a04ba810f48 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.433328 Nov 23 04:14:48.377580 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2672e0b0-2606-4644-94ba-0b7f45986575 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.485491 Nov 23 04:14:48.378756 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 41/78] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:47 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:48.385196 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 38/79] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:47 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:48.467416 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-f1f6167c-d55b-429a-8570-3a93b126c7fc req-d09e4c64-eacd-4596-bc29-d1b3b613f18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6648b45-9a0f-4dd2-8a71-d53921d23d91", "tag": "6a7ea38e-87d3-4079-a13a-d1258a7c04f9"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:48.469071 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:14:48.469071 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:14:48.476873 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-f1f6167c-d55b-429a-8570-3a93b126c7fc req-d09e4c64-eacd-4596-bc29-d1b3b613f18a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:48.477316 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-f1f6167c-d55b-429a-8570-3a93b126c7fc req-d09e4c64-eacd-4596-bc29-d1b3b613f18a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:48.485570 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8da7ea6d-5d2a-4f03-afc9-1097678f7406 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:48.488742 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8da7ea6d-5d2a-4f03-afc9-1097678f7406 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:48.489824 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-f1f6167c-d55b-429a-8570-3a93b126c7fc req-d09e4c64-eacd-4596-bc29-d1b3b613f18a service nova] Creating event network-changed:6a7ea38e-87d3-4079-a13a-d1258a7c04f9 for instance e6648b45-9a0f-4dd2-8a71-d53921d23d91 on hv-cinder-76845 Nov 23 04:14:48.497516 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-f1f6167c-d55b-429a-8570-3a93b126c7fc req-d09e4c64-eacd-4596-bc29-d1b3b613f18a service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032114 Nov 23 04:14:48.502661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8da7ea6d-5d2a-4f03-afc9-1097678f7406 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:48.502661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8da7ea6d-5d2a-4f03-afc9-1097678f7406 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:48.503241 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 42/80] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:14:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:48.503340 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8da7ea6d-5d2a-4f03-afc9-1097678f7406 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:48.503340 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8da7ea6d-5d2a-4f03-afc9-1097678f7406 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:48.508681 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-96bab780-6777-4861-880f-4a849ca76558 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:48.509381 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-96bab780-6777-4861-880f-4a849ca76558 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:48.517269 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-96bab780-6777-4861-880f-4a849ca76558 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:48.517793 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-96bab780-6777-4861-880f-4a849ca76558 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:48.518655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-96bab780-6777-4861-880f-4a849ca76558 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:48.519074 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-96bab780-6777-4861-880f-4a849ca76558 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:49.201308 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8da7ea6d-5d2a-4f03-afc9-1097678f7406 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:49.209864 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8da7ea6d-5d2a-4f03-afc9-1097678f7406 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.727884 Nov 23 04:14:49.210654 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 39/81] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:48 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:49.216949 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-96bab780-6777-4861-880f-4a849ca76558 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:49.225719 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-96bab780-6777-4861-880f-4a849ca76558 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:49.233576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-96bab780-6777-4861-880f-4a849ca76558 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:49.233576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-96bab780-6777-4861-880f-4a849ca76558 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.727567 Nov 23 04:14:49.233576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 43/82] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:48 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:49.397518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-faeaa9c6-3c31-4b1c-b0b3-6949f6ea1ea3 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:49.398697 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-849abc8e-e561-4f94-9938-35f5c2c5e5a1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:49.400118 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-faeaa9c6-3c31-4b1c-b0b3-6949f6ea1ea3 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:49.402187 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-849abc8e-e561-4f94-9938-35f5c2c5e5a1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:49.415853 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-faeaa9c6-3c31-4b1c-b0b3-6949f6ea1ea3 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:49.415963 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-849abc8e-e561-4f94-9938-35f5c2c5e5a1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:49.415963 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-849abc8e-e561-4f94-9938-35f5c2c5e5a1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:49.416125 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-faeaa9c6-3c31-4b1c-b0b3-6949f6ea1ea3 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:49.416854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-faeaa9c6-3c31-4b1c-b0b3-6949f6ea1ea3 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:49.417280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-faeaa9c6-3c31-4b1c-b0b3-6949f6ea1ea3 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:49.419092 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-849abc8e-e561-4f94-9938-35f5c2c5e5a1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:49.423566 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-849abc8e-e561-4f94-9938-35f5c2c5e5a1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:49.870256 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-849abc8e-e561-4f94-9938-35f5c2c5e5a1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:49.881549 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-849abc8e-e561-4f94-9938-35f5c2c5e5a1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.492786 Nov 23 04:14:49.884852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-faeaa9c6-3c31-4b1c-b0b3-6949f6ea1ea3 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:49.891395 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 40/83] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:49 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:49.896171 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-faeaa9c6-3c31-4b1c-b0b3-6949f6ea1ea3 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.505261 Nov 23 04:14:49.899282 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 44/84] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:49 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:49.977985 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-14c07e64-96c9-4db4-86c8-a09984aaea1e req-d51ae7e5-8802-4e9e-923c-a92ea721eee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87273409-979f-4dd3-b901-60f00ba87d4c", "name": "network-vif-plugged", "status": "completed", "tag": "832e3d40-1fef-4a95-9553-b2e7c02d57af"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:49.982143 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:14:49.982143 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:14:50.001547 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-14c07e64-96c9-4db4-86c8-a09984aaea1e req-d51ae7e5-8802-4e9e-923c-a92ea721eee2 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:50.007883 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-14c07e64-96c9-4db4-86c8-a09984aaea1e req-d51ae7e5-8802-4e9e-923c-a92ea721eee2 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:50.035071 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-14c07e64-96c9-4db4-86c8-a09984aaea1e req-d51ae7e5-8802-4e9e-923c-a92ea721eee2 service nova] Creating event network-vif-plugged:832e3d40-1fef-4a95-9553-b2e7c02d57af for instance 87273409-979f-4dd3-b901-60f00ba87d4c on hv-cinder-76845 Nov 23 04:14:50.046209 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-14c07e64-96c9-4db4-86c8-a09984aaea1e req-d51ae7e5-8802-4e9e-923c-a92ea721eee2 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150405 Nov 23 04:14:50.047692 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 41/85] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:14:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:50.227111 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bb246190-5784-460e-821a-82dfdbb2adb7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:50.227824 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bb246190-5784-460e-821a-82dfdbb2adb7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:50.234656 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb246190-5784-460e-821a-82dfdbb2adb7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:50.235107 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb246190-5784-460e-821a-82dfdbb2adb7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:50.235981 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb246190-5784-460e-821a-82dfdbb2adb7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:50.236416 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb246190-5784-460e-821a-82dfdbb2adb7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:50.251873 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2c36eddb-c151-4c08-bd68-eda53f0bb5ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:50.252291 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2c36eddb-c151-4c08-bd68-eda53f0bb5ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:50.295767 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2c36eddb-c151-4c08-bd68-eda53f0bb5ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:50.298049 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2c36eddb-c151-4c08-bd68-eda53f0bb5ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:50.302430 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2c36eddb-c151-4c08-bd68-eda53f0bb5ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:50.302930 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2c36eddb-c151-4c08-bd68-eda53f0bb5ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:50.645918 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2c36eddb-c151-4c08-bd68-eda53f0bb5ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:50.655135 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2c36eddb-c151-4c08-bd68-eda53f0bb5ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:50.655822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-bb246190-5784-460e-821a-82dfdbb2adb7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:50.656656 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2c36eddb-c151-4c08-bd68-eda53f0bb5ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:50.658816 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2c36eddb-c151-4c08-bd68-eda53f0bb5ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.413162 Nov 23 04:14:50.659513 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 42/86] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:50 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:50.673072 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-f7217809-3c74-431f-8a24-f0942a4b2229 req-8091f57a-9759-40d0-bf06-db20a6d507d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c13d4db-587d-4d4e-b8cc-23632d768572", "tag": "1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:50.674711 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:14:50.674711 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:14:50.674908 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bb246190-5784-460e-821a-82dfdbb2adb7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.444243 Nov 23 04:14:50.676099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 45/87] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:50 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:50.688070 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-f7217809-3c74-431f-8a24-f0942a4b2229 req-8091f57a-9759-40d0-bf06-db20a6d507d3 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:50.688512 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-f7217809-3c74-431f-8a24-f0942a4b2229 req-8091f57a-9759-40d0-bf06-db20a6d507d3 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:50.699782 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-f7217809-3c74-431f-8a24-f0942a4b2229 req-8091f57a-9759-40d0-bf06-db20a6d507d3 service nova] Creating event network-changed:1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2 for instance 8c13d4db-587d-4d4e-b8cc-23632d768572 on hv-cinder-76845 Nov 23 04:14:50.704853 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-f7217809-3c74-431f-8a24-f0942a4b2229 req-8091f57a-9759-40d0-bf06-db20a6d507d3 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043949 Nov 23 04:14:50.705445 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 43/88] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:14:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:50.901244 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-800609fe-797c-4e96-85b4-13693b7c515e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:50.902808 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-800609fe-797c-4e96-85b4-13693b7c515e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:50.915121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-800609fe-797c-4e96-85b4-13693b7c515e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:50.918176 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-800609fe-797c-4e96-85b4-13693b7c515e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:50.918176 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-800609fe-797c-4e96-85b4-13693b7c515e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:50.918176 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-800609fe-797c-4e96-85b4-13693b7c515e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:50.920765 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-74bab7eb-bf4e-45ab-8601-3d8ac0baf0f8 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:50.923611 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-74bab7eb-bf4e-45ab-8601-3d8ac0baf0f8 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:50.942213 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-74bab7eb-bf4e-45ab-8601-3d8ac0baf0f8 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:50.942213 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-74bab7eb-bf4e-45ab-8601-3d8ac0baf0f8 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:50.942213 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-74bab7eb-bf4e-45ab-8601-3d8ac0baf0f8 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:50.942213 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-74bab7eb-bf4e-45ab-8601-3d8ac0baf0f8 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:51.338601 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-74bab7eb-bf4e-45ab-8601-3d8ac0baf0f8 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:51.344249 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-74bab7eb-bf4e-45ab-8601-3d8ac0baf0f8 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.431415 Nov 23 04:14:51.344831 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 44/89] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:50 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:51.345925 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-800609fe-797c-4e96-85b4-13693b7c515e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:51.356558 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-800609fe-797c-4e96-85b4-13693b7c515e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.460397 Nov 23 04:14:51.357685 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 46/90] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:50 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:51.682932 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-04fb98b2-c0ab-4f31-955e-fd4e7e62cc6f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:51.682932 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-04fb98b2-c0ab-4f31-955e-fd4e7e62cc6f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:51.689913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-04fb98b2-c0ab-4f31-955e-fd4e7e62cc6f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:51.690430 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-04fb98b2-c0ab-4f31-955e-fd4e7e62cc6f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:51.691342 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-04fb98b2-c0ab-4f31-955e-fd4e7e62cc6f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:51.691840 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-04fb98b2-c0ab-4f31-955e-fd4e7e62cc6f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:51.694006 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-cccc16da-084b-44a5-95d0-f5e5ac499bfb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:51.694944 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-cccc16da-084b-44a5-95d0-f5e5ac499bfb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:51.705906 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cccc16da-084b-44a5-95d0-f5e5ac499bfb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:51.706901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cccc16da-084b-44a5-95d0-f5e5ac499bfb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:51.708572 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cccc16da-084b-44a5-95d0-f5e5ac499bfb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:51.709348 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cccc16da-084b-44a5-95d0-f5e5ac499bfb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:51.957740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-04fb98b2-c0ab-4f31-955e-fd4e7e62cc6f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:51.966443 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-04fb98b2-c0ab-4f31-955e-fd4e7e62cc6f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:51.970598 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-04fb98b2-c0ab-4f31-955e-fd4e7e62cc6f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:51.970598 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-04fb98b2-c0ab-4f31-955e-fd4e7e62cc6f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.295323 Nov 23 04:14:51.970598 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 45/91] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:51 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:51.989452 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-cccc16da-084b-44a5-95d0-f5e5ac499bfb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:52.004260 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-cccc16da-084b-44a5-95d0-f5e5ac499bfb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.315261 Nov 23 04:14:52.005387 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 47/92] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:51 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:52.086031 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-7c868a39-a819-4dad-aa7d-6fd61f5dcf81 req-fa4ab805-1239-4cb6-a828-c77d6c4263ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e50b4e8-8b55-4abf-b356-7e130ff4c5a5", "name": "network-vif-plugged", "status": "completed", "tag": "5802ea66-681d-4f76-a561-6e2e0d2de725"}, {"server_uuid": "696e3da2-6fdb-4741-8f4f-fffccaf8d403", "name": "network-vif-plugged", "status": "completed", "tag": "f48f6a3d-794b-4b20-922c-ac55129a50c5"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:14:52.087891 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:14:52.087891 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:14:52.096682 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-7c868a39-a819-4dad-aa7d-6fd61f5dcf81 req-fa4ab805-1239-4cb6-a828-c77d6c4263ed service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:52.097206 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-7c868a39-a819-4dad-aa7d-6fd61f5dcf81 req-fa4ab805-1239-4cb6-a828-c77d6c4263ed service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:52.109440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-7c868a39-a819-4dad-aa7d-6fd61f5dcf81 req-fa4ab805-1239-4cb6-a828-c77d6c4263ed service nova] Creating event network-vif-plugged:5802ea66-681d-4f76-a561-6e2e0d2de725 for instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 on hv-cinder-76845 Nov 23 04:14:52.110155 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-7c868a39-a819-4dad-aa7d-6fd61f5dcf81 req-fa4ab805-1239-4cb6-a828-c77d6c4263ed service nova] Creating event network-vif-plugged:f48f6a3d-794b-4b20-922c-ac55129a50c5 for instance 696e3da2-6fdb-4741-8f4f-fffccaf8d403 on hv-cinder-76845 Nov 23 04:14:52.116800 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-7c868a39-a819-4dad-aa7d-6fd61f5dcf81 req-fa4ab805-1239-4cb6-a828-c77d6c4263ed service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034824 Nov 23 04:14:52.120027 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 46/93] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:14:52 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:14:52.361924 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dff6d257-2788-4d20-8403-663864e1eef6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:52.362518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dff6d257-2788-4d20-8403-663864e1eef6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:52.372278 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dff6d257-2788-4d20-8403-663864e1eef6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:52.378313 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dff6d257-2788-4d20-8403-663864e1eef6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:52.378313 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dff6d257-2788-4d20-8403-663864e1eef6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:52.378313 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dff6d257-2788-4d20-8403-663864e1eef6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:52.380702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-490906e6-7334-4996-a003-c6f08e35a9d4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:52.381688 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-490906e6-7334-4996-a003-c6f08e35a9d4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:52.398121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-490906e6-7334-4996-a003-c6f08e35a9d4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:52.399495 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-490906e6-7334-4996-a003-c6f08e35a9d4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:52.400288 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-490906e6-7334-4996-a003-c6f08e35a9d4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:52.400679 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-490906e6-7334-4996-a003-c6f08e35a9d4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:52.537591 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dff6d257-2788-4d20-8403-663864e1eef6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:52.545805 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dff6d257-2788-4d20-8403-663864e1eef6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.187595 Nov 23 04:14:52.546386 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 48/94] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:52 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:52.596115 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-490906e6-7334-4996-a003-c6f08e35a9d4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:52.605844 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-490906e6-7334-4996-a003-c6f08e35a9d4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.234501 Nov 23 04:14:52.606694 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 47/95] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:52 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:52.987416 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-032814c2-b324-46be-b8f2-e35be5e23380 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:52.988085 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-032814c2-b324-46be-b8f2-e35be5e23380 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:52.994190 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-032814c2-b324-46be-b8f2-e35be5e23380 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:52.994781 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-032814c2-b324-46be-b8f2-e35be5e23380 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:52.995450 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-032814c2-b324-46be-b8f2-e35be5e23380 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:52.996502 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-032814c2-b324-46be-b8f2-e35be5e23380 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:53.021233 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-02d2b266-2620-41ea-8ea7-89c13247d4a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:53.021845 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-02d2b266-2620-41ea-8ea7-89c13247d4a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:53.028118 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02d2b266-2620-41ea-8ea7-89c13247d4a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:53.028565 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02d2b266-2620-41ea-8ea7-89c13247d4a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:53.033276 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02d2b266-2620-41ea-8ea7-89c13247d4a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:53.033276 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02d2b266-2620-41ea-8ea7-89c13247d4a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:53.210107 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-032814c2-b324-46be-b8f2-e35be5e23380 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:53.214614 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-02d2b266-2620-41ea-8ea7-89c13247d4a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:53.219849 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-032814c2-b324-46be-b8f2-e35be5e23380 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:53.223239 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-032814c2-b324-46be-b8f2-e35be5e23380 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:53.223371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-02d2b266-2620-41ea-8ea7-89c13247d4a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.204487 Nov 23 04:14:53.223464 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-032814c2-b324-46be-b8f2-e35be5e23380 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.238726 Nov 23 04:14:53.223540 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 48/96] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:53 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:53.223624 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 49/97] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:52 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:53.562806 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-02085c91-4d5b-4d13-9a84-135b8c23d79a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:53.563439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-02085c91-4d5b-4d13-9a84-135b8c23d79a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:53.569100 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02085c91-4d5b-4d13-9a84-135b8c23d79a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:53.571461 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02085c91-4d5b-4d13-9a84-135b8c23d79a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:53.571461 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02085c91-4d5b-4d13-9a84-135b8c23d79a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:53.571461 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02085c91-4d5b-4d13-9a84-135b8c23d79a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:53.624252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a64924f1-6472-43e2-b614-44e023c8f1aa tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:53.624865 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a64924f1-6472-43e2-b614-44e023c8f1aa tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:53.636803 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a64924f1-6472-43e2-b614-44e023c8f1aa tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:53.640487 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a64924f1-6472-43e2-b614-44e023c8f1aa tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:53.640487 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a64924f1-6472-43e2-b614-44e023c8f1aa tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:53.640487 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a64924f1-6472-43e2-b614-44e023c8f1aa tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:53.774411 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-02085c91-4d5b-4d13-9a84-135b8c23d79a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:53.783522 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-02085c91-4d5b-4d13-9a84-135b8c23d79a tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.224286 Nov 23 04:14:53.784622 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 49/98] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:53 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:53.838356 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a64924f1-6472-43e2-b614-44e023c8f1aa tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:53.845793 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a64924f1-6472-43e2-b614-44e023c8f1aa tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.226161 Nov 23 04:14:53.846360 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 50/99] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:53 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:54.239135 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f4cd78bf-372c-4fbb-b0d0-3eaa957b9af2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:54.239848 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-10bd4912-eb83-4971-a173-261c8f34d6e8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:54.240353 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f4cd78bf-372c-4fbb-b0d0-3eaa957b9af2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:54.240462 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-10bd4912-eb83-4971-a173-261c8f34d6e8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:54.245574 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f4cd78bf-372c-4fbb-b0d0-3eaa957b9af2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:54.246062 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f4cd78bf-372c-4fbb-b0d0-3eaa957b9af2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:54.246619 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-10bd4912-eb83-4971-a173-261c8f34d6e8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:54.246849 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f4cd78bf-372c-4fbb-b0d0-3eaa957b9af2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:54.247073 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-10bd4912-eb83-4971-a173-261c8f34d6e8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:54.247309 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f4cd78bf-372c-4fbb-b0d0-3eaa957b9af2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:54.247875 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-10bd4912-eb83-4971-a173-261c8f34d6e8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:54.248314 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-10bd4912-eb83-4971-a173-261c8f34d6e8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:54.457592 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f4cd78bf-372c-4fbb-b0d0-3eaa957b9af2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:54.466960 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-10bd4912-eb83-4971-a173-261c8f34d6e8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:54.467472 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f4cd78bf-372c-4fbb-b0d0-3eaa957b9af2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.231579 Nov 23 04:14:54.469002 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 50/100] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:54 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:54.481655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-10bd4912-eb83-4971-a173-261c8f34d6e8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:54.488505 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-10bd4912-eb83-4971-a173-261c8f34d6e8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:54.491998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-10bd4912-eb83-4971-a173-261c8f34d6e8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.253707 Nov 23 04:14:54.491998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 51/101] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:54 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:14:54.801538 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b86c4fe5-1eb9-4887-b8fb-837d3293d1e0 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:54.802139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b86c4fe5-1eb9-4887-b8fb-837d3293d1e0 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:54.807978 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b86c4fe5-1eb9-4887-b8fb-837d3293d1e0 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:54.808472 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b86c4fe5-1eb9-4887-b8fb-837d3293d1e0 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:54.809310 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b86c4fe5-1eb9-4887-b8fb-837d3293d1e0 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:54.809740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b86c4fe5-1eb9-4887-b8fb-837d3293d1e0 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:54.862579 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a9f7bfba-e3d9-4e00-b363-98f2f28906d6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:54.863056 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a9f7bfba-e3d9-4e00-b363-98f2f28906d6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:54.870253 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a9f7bfba-e3d9-4e00-b363-98f2f28906d6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:54.870253 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a9f7bfba-e3d9-4e00-b363-98f2f28906d6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:54.870253 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a9f7bfba-e3d9-4e00-b363-98f2f28906d6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:54.870518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a9f7bfba-e3d9-4e00-b363-98f2f28906d6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:54.980805 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-b86c4fe5-1eb9-4887-b8fb-837d3293d1e0 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:54.992243 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b86c4fe5-1eb9-4887-b8fb-837d3293d1e0 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.194251 Nov 23 04:14:54.995656 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 51/102] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:54 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:55.057710 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a9f7bfba-e3d9-4e00-b363-98f2f28906d6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:55.067533 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a9f7bfba-e3d9-4e00-b363-98f2f28906d6 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.208332 Nov 23 04:14:55.079096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 52/103] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:54 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:55.485193 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-144f3b8f-d40b-4167-b439-becf0d11aed5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:55.485833 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-144f3b8f-d40b-4167-b439-becf0d11aed5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:55.491647 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-144f3b8f-d40b-4167-b439-becf0d11aed5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:55.492126 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-144f3b8f-d40b-4167-b439-becf0d11aed5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:55.492921 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-144f3b8f-d40b-4167-b439-becf0d11aed5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:55.493358 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-144f3b8f-d40b-4167-b439-becf0d11aed5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:55.507586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a358e761-ecc0-49c7-aa62-1e5cf9f0a87e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:55.508404 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a358e761-ecc0-49c7-aa62-1e5cf9f0a87e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:55.517057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a358e761-ecc0-49c7-aa62-1e5cf9f0a87e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:55.517629 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a358e761-ecc0-49c7-aa62-1e5cf9f0a87e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:55.518574 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a358e761-ecc0-49c7-aa62-1e5cf9f0a87e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:55.519103 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a358e761-ecc0-49c7-aa62-1e5cf9f0a87e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:55.784719 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-144f3b8f-d40b-4167-b439-becf0d11aed5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:55.792016 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a358e761-ecc0-49c7-aa62-1e5cf9f0a87e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:55.792559 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-144f3b8f-d40b-4167-b439-becf0d11aed5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.310973 Nov 23 04:14:55.793349 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 52/104] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:55 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:55.799862 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a358e761-ecc0-49c7-aa62-1e5cf9f0a87e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:55.801406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a358e761-ecc0-49c7-aa62-1e5cf9f0a87e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:55.809615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a358e761-ecc0-49c7-aa62-1e5cf9f0a87e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.298655 Nov 23 04:14:55.809615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 53/105] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:55 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:14:56.009087 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-02b6116a-80a8-4c86-99ac-dacc86036f51 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:56.012317 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-02b6116a-80a8-4c86-99ac-dacc86036f51 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:56.020650 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02b6116a-80a8-4c86-99ac-dacc86036f51 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:56.021307 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02b6116a-80a8-4c86-99ac-dacc86036f51 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:56.022104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02b6116a-80a8-4c86-99ac-dacc86036f51 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:56.022546 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-02b6116a-80a8-4c86-99ac-dacc86036f51 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:56.084863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-243918b9-9fba-4f0f-b396-23434c1bc6bb tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:56.085757 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-243918b9-9fba-4f0f-b396-23434c1bc6bb tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:56.093004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-243918b9-9fba-4f0f-b396-23434c1bc6bb tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:56.093781 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-243918b9-9fba-4f0f-b396-23434c1bc6bb tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:56.094960 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-243918b9-9fba-4f0f-b396-23434c1bc6bb tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:56.096081 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-243918b9-9fba-4f0f-b396-23434c1bc6bb tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:56.364829 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-02b6116a-80a8-4c86-99ac-dacc86036f51 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:56.372785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-02b6116a-80a8-4c86-99ac-dacc86036f51 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.367259 Nov 23 04:14:56.373473 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 53/106] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:56 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:56.380959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-243918b9-9fba-4f0f-b396-23434c1bc6bb tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:56.390365 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-243918b9-9fba-4f0f-b396-23434c1bc6bb tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.309247 Nov 23 04:14:56.390976 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 54/107] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:56 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:56.811824 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3ae36697-e8b0-4fce-9677-09fdf6ec39d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:56.812598 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3ae36697-e8b0-4fce-9677-09fdf6ec39d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:56.819626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3ae36697-e8b0-4fce-9677-09fdf6ec39d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:56.820072 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3ae36697-e8b0-4fce-9677-09fdf6ec39d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:56.821389 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3ae36697-e8b0-4fce-9677-09fdf6ec39d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:56.821830 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3ae36697-e8b0-4fce-9677-09fdf6ec39d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:56.825929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4502f041-30eb-40a8-940d-6a97bd4ff404 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:56.826545 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4502f041-30eb-40a8-940d-6a97bd4ff404 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:56.833128 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4502f041-30eb-40a8-940d-6a97bd4ff404 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:56.833738 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4502f041-30eb-40a8-940d-6a97bd4ff404 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:56.834794 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4502f041-30eb-40a8-940d-6a97bd4ff404 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:56.835247 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4502f041-30eb-40a8-940d-6a97bd4ff404 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:57.167620 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3ae36697-e8b0-4fce-9677-09fdf6ec39d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:57.175429 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3ae36697-e8b0-4fce-9677-09fdf6ec39d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.368712 Nov 23 04:14:57.192884 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 54/108] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:56 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:57.210945 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4502f041-30eb-40a8-940d-6a97bd4ff404 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:57.220309 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4502f041-30eb-40a8-940d-6a97bd4ff404 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:57.222004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4502f041-30eb-40a8-940d-6a97bd4ff404 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:57.223118 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4502f041-30eb-40a8-940d-6a97bd4ff404 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.401406 Nov 23 04:14:57.223695 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 55/109] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:56 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:14:57.392494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-28174f8c-c685-4ed6-b663-34661189693b tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:57.393696 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-28174f8c-c685-4ed6-b663-34661189693b tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:57.401854 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-28174f8c-c685-4ed6-b663-34661189693b tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:57.403282 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-28174f8c-c685-4ed6-b663-34661189693b tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:57.404943 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-28174f8c-c685-4ed6-b663-34661189693b tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:57.405858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-28174f8c-c685-4ed6-b663-34661189693b tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:57.441733 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fab604df-c221-4a53-b4cb-20e262d3f820 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:57.441733 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fab604df-c221-4a53-b4cb-20e262d3f820 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:57.454199 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fab604df-c221-4a53-b4cb-20e262d3f820 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:57.454662 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fab604df-c221-4a53-b4cb-20e262d3f820 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:57.455493 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fab604df-c221-4a53-b4cb-20e262d3f820 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:57.455920 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fab604df-c221-4a53-b4cb-20e262d3f820 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:57.818079 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-fab604df-c221-4a53-b4cb-20e262d3f820 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:57.825675 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-28174f8c-c685-4ed6-b663-34661189693b tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:57.826152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fab604df-c221-4a53-b4cb-20e262d3f820 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.419611 Nov 23 04:14:57.827014 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 56/110] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:57 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:57.833392 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-28174f8c-c685-4ed6-b663-34661189693b tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.447154 Nov 23 04:14:57.834142 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 55/111] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:57 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:58.192681 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-86eb097e-8383-4a24-b1e0-257d8541d3a5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:58.193286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-86eb097e-8383-4a24-b1e0-257d8541d3a5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:58.199813 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-86eb097e-8383-4a24-b1e0-257d8541d3a5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:58.203076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-86eb097e-8383-4a24-b1e0-257d8541d3a5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:58.203076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-86eb097e-8383-4a24-b1e0-257d8541d3a5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:58.203076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-86eb097e-8383-4a24-b1e0-257d8541d3a5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:58.241316 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0d241224-80f4-4e1d-a561-36ef9566dd9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:58.242035 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0d241224-80f4-4e1d-a561-36ef9566dd9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:58.249146 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0d241224-80f4-4e1d-a561-36ef9566dd9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:58.249624 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0d241224-80f4-4e1d-a561-36ef9566dd9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:58.250441 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0d241224-80f4-4e1d-a561-36ef9566dd9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:58.250886 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0d241224-80f4-4e1d-a561-36ef9566dd9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:58.368386 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-86eb097e-8383-4a24-b1e0-257d8541d3a5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:58.377134 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-86eb097e-8383-4a24-b1e0-257d8541d3a5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.188091 Nov 23 04:14:58.377716 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 57/112] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:58 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:58.414353 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0d241224-80f4-4e1d-a561-36ef9566dd9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:58.422970 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0d241224-80f4-4e1d-a561-36ef9566dd9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:58.424488 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0d241224-80f4-4e1d-a561-36ef9566dd9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:58.425583 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0d241224-80f4-4e1d-a561-36ef9566dd9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.188035 Nov 23 04:14:58.426139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 56/113] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:58 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:14:58.843365 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-eef4a999-88ee-4aec-b986-55c42711b130 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:58.844124 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-eef4a999-88ee-4aec-b986-55c42711b130 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:58.850003 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-eb8706e1-f4ad-478b-8026-0ae47d32aaba tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:58.850448 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eef4a999-88ee-4aec-b986-55c42711b130 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:58.850658 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-eb8706e1-f4ad-478b-8026-0ae47d32aaba tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:58.851011 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eef4a999-88ee-4aec-b986-55c42711b130 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:58.851893 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eef4a999-88ee-4aec-b986-55c42711b130 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:58.852395 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eef4a999-88ee-4aec-b986-55c42711b130 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:58.858392 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb8706e1-f4ad-478b-8026-0ae47d32aaba tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:58.859171 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb8706e1-f4ad-478b-8026-0ae47d32aaba tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:58.860180 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb8706e1-f4ad-478b-8026-0ae47d32aaba tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:58.860748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb8706e1-f4ad-478b-8026-0ae47d32aaba tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:59.047400 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-eef4a999-88ee-4aec-b986-55c42711b130 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:59.054387 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-eb8706e1-f4ad-478b-8026-0ae47d32aaba tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:59.054934 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-eef4a999-88ee-4aec-b986-55c42711b130 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.215870 Nov 23 04:14:59.055548 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 58/114] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:58 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:59.062404 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-eb8706e1-f4ad-478b-8026-0ae47d32aaba tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.216611 Nov 23 04:14:59.062963 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 57/115] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:58 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:14:59.393756 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-edfa9dde-954f-4db0-b8e0-430ea66f0eb8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:59.394278 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-edfa9dde-954f-4db0-b8e0-430ea66f0eb8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:59.400168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-edfa9dde-954f-4db0-b8e0-430ea66f0eb8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:59.400614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-edfa9dde-954f-4db0-b8e0-430ea66f0eb8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:59.401372 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-edfa9dde-954f-4db0-b8e0-430ea66f0eb8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:59.401804 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-edfa9dde-954f-4db0-b8e0-430ea66f0eb8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:59.444500 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d518bf0a-9176-4496-b12d-40adcf0629ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:14:59.445105 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d518bf0a-9176-4496-b12d-40adcf0629ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:14:59.451352 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d518bf0a-9176-4496-b12d-40adcf0629ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:59.451802 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d518bf0a-9176-4496-b12d-40adcf0629ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:59.452580 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d518bf0a-9176-4496-b12d-40adcf0629ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:14:59.453020 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d518bf0a-9176-4496-b12d-40adcf0629ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:14:59.574594 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-edfa9dde-954f-4db0-b8e0-430ea66f0eb8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:59.582714 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-edfa9dde-954f-4db0-b8e0-430ea66f0eb8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.192624 Nov 23 04:14:59.583314 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 59/116] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:14:59 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:14:59.620187 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d518bf0a-9176-4496-b12d-40adcf0629ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:59.628111 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d518bf0a-9176-4496-b12d-40adcf0629ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:59.629591 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d518bf0a-9176-4496-b12d-40adcf0629ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:14:59.630686 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d518bf0a-9176-4496-b12d-40adcf0629ae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.189910 Nov 23 04:14:59.631257 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 58/117] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:14:59 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:15:00.071672 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-359b88b9-dea8-4e14-80d8-76ac17cd6728 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:00.072276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-359b88b9-dea8-4e14-80d8-76ac17cd6728 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:00.078355 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-775dce2d-55dc-46f2-968a-9c1a5d789fb1 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:00.078847 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-359b88b9-dea8-4e14-80d8-76ac17cd6728 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:00.078947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-775dce2d-55dc-46f2-968a-9c1a5d789fb1 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:00.079324 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-359b88b9-dea8-4e14-80d8-76ac17cd6728 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:00.080096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-359b88b9-dea8-4e14-80d8-76ac17cd6728 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:00.080527 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-359b88b9-dea8-4e14-80d8-76ac17cd6728 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:00.084627 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-775dce2d-55dc-46f2-968a-9c1a5d789fb1 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:00.085077 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-775dce2d-55dc-46f2-968a-9c1a5d789fb1 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:00.085862 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-775dce2d-55dc-46f2-968a-9c1a5d789fb1 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:00.086294 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-775dce2d-55dc-46f2-968a-9c1a5d789fb1 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:00.304140 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-775dce2d-55dc-46f2-968a-9c1a5d789fb1 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:00.312088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-775dce2d-55dc-46f2-968a-9c1a5d789fb1 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.237376 Nov 23 04:15:00.312750 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 59/118] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:00 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:00.317350 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-359b88b9-dea8-4e14-80d8-76ac17cd6728 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:00.325503 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-359b88b9-dea8-4e14-80d8-76ac17cd6728 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.257324 Nov 23 04:15:00.333020 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 60/119] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:00 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:00.599795 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-20cf6c55-1191-4b9b-ad5d-096a0d5ae55d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:00.600325 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-20cf6c55-1191-4b9b-ad5d-096a0d5ae55d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:00.606791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20cf6c55-1191-4b9b-ad5d-096a0d5ae55d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:00.607250 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20cf6c55-1191-4b9b-ad5d-096a0d5ae55d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:00.608019 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20cf6c55-1191-4b9b-ad5d-096a0d5ae55d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:00.608448 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20cf6c55-1191-4b9b-ad5d-096a0d5ae55d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:00.647845 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a7999a23-8f11-4342-a317-e4d7551157e4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:00.648434 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a7999a23-8f11-4342-a317-e4d7551157e4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:00.654605 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a7999a23-8f11-4342-a317-e4d7551157e4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:00.655081 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a7999a23-8f11-4342-a317-e4d7551157e4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:00.655905 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a7999a23-8f11-4342-a317-e4d7551157e4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:00.656344 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a7999a23-8f11-4342-a317-e4d7551157e4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:00.817083 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-20cf6c55-1191-4b9b-ad5d-096a0d5ae55d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:00.825489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-20cf6c55-1191-4b9b-ad5d-096a0d5ae55d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.229260 Nov 23 04:15:00.826073 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 60/120] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:00 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:00.845527 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a7999a23-8f11-4342-a317-e4d7551157e4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:00.853213 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a7999a23-8f11-4342-a317-e4d7551157e4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:00.854953 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a7999a23-8f11-4342-a317-e4d7551157e4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:00.856058 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a7999a23-8f11-4342-a317-e4d7551157e4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.211915 Nov 23 04:15:00.856620 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 61/121] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:15:00 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:15:01.329518 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-55fdba86-704d-405a-b48c-4d7a15a675d6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:01.330068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-55fdba86-704d-405a-b48c-4d7a15a675d6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:01.336028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-55fdba86-704d-405a-b48c-4d7a15a675d6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:01.336683 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-55fdba86-704d-405a-b48c-4d7a15a675d6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:01.337478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-55fdba86-704d-405a-b48c-4d7a15a675d6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:01.337911 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-55fdba86-704d-405a-b48c-4d7a15a675d6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:01.347774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8df65a2f-8b59-442e-be55-a3e71779e0df tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:01.348387 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8df65a2f-8b59-442e-be55-a3e71779e0df tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:01.354558 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8df65a2f-8b59-442e-be55-a3e71779e0df tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:01.355635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8df65a2f-8b59-442e-be55-a3e71779e0df tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:01.357873 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8df65a2f-8b59-442e-be55-a3e71779e0df tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:01.358376 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8df65a2f-8b59-442e-be55-a3e71779e0df tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:01.558540 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-55fdba86-704d-405a-b48c-4d7a15a675d6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:01.562860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8df65a2f-8b59-442e-be55-a3e71779e0df tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:01.569187 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-55fdba86-704d-405a-b48c-4d7a15a675d6 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1314 microversion: 2.1 time: 0.241663 Nov 23 04:15:01.569187 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 61/122] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:01 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:01.572164 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8df65a2f-8b59-442e-be55-a3e71779e0df tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1318 microversion: 2.1 time: 0.228064 Nov 23 04:15:01.572722 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 62/123] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:01 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:01.842402 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9aeb0651-8b0c-43ff-aae8-3da4f1e16a0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:01.842953 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9aeb0651-8b0c-43ff-aae8-3da4f1e16a0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:01.848844 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9aeb0651-8b0c-43ff-aae8-3da4f1e16a0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:01.849394 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9aeb0651-8b0c-43ff-aae8-3da4f1e16a0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:01.850236 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9aeb0651-8b0c-43ff-aae8-3da4f1e16a0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:01.850662 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9aeb0651-8b0c-43ff-aae8-3da4f1e16a0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:01.878600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a85af58f-5fa3-49b9-9c81-073f5520ffc1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:01.879119 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a85af58f-5fa3-49b9-9c81-073f5520ffc1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:01.885081 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a85af58f-5fa3-49b9-9c81-073f5520ffc1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:01.885746 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a85af58f-5fa3-49b9-9c81-073f5520ffc1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:01.887633 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a85af58f-5fa3-49b9-9c81-073f5520ffc1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:01.888145 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a85af58f-5fa3-49b9-9c81-073f5520ffc1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:02.039423 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9aeb0651-8b0c-43ff-aae8-3da4f1e16a0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:02.048211 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9aeb0651-8b0c-43ff-aae8-3da4f1e16a0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.209883 Nov 23 04:15:02.048957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 62/124] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:01 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:02.079747 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a85af58f-5fa3-49b9-9c81-073f5520ffc1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:02.088233 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a85af58f-5fa3-49b9-9c81-073f5520ffc1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:02.089869 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a85af58f-5fa3-49b9-9c81-073f5520ffc1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:02.091236 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a85af58f-5fa3-49b9-9c81-073f5520ffc1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.216275 Nov 23 04:15:02.091807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 63/125] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:15:01 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:15:02.584174 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3e8a15f3-3a92-4c58-ac95-918d56dc0123 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:02.585081 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3e8a15f3-3a92-4c58-ac95-918d56dc0123 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:02.591294 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0c2323da-1e60-4e67-b17b-6a7597ae8b3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:02.592033 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3e8a15f3-3a92-4c58-ac95-918d56dc0123 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:02.593510 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0c2323da-1e60-4e67-b17b-6a7597ae8b3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:02.598393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3e8a15f3-3a92-4c58-ac95-918d56dc0123 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:02.600800 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3e8a15f3-3a92-4c58-ac95-918d56dc0123 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:02.601466 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3e8a15f3-3a92-4c58-ac95-918d56dc0123 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:02.604549 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0c2323da-1e60-4e67-b17b-6a7597ae8b3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:02.604549 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0c2323da-1e60-4e67-b17b-6a7597ae8b3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:02.604549 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0c2323da-1e60-4e67-b17b-6a7597ae8b3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:02.604770 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0c2323da-1e60-4e67-b17b-6a7597ae8b3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:02.823929 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3e8a15f3-3a92-4c58-ac95-918d56dc0123 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:02.832286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0c2323da-1e60-4e67-b17b-6a7597ae8b3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:02.833676 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3e8a15f3-3a92-4c58-ac95-918d56dc0123 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1500 microversion: 2.1 time: 0.253243 Nov 23 04:15:02.845560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 63/126] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:02 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1500 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:02.845560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-e62dedd3-e62f-412d-a6b2-c49a44fb567f req-f1480617-56d2-4053-a38c-1bfbec7985ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c13d4db-587d-4d4e-b8cc-23632d768572", "name": "network-vif-plugged", "status": "completed", "tag": "1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:02.845833 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0c2323da-1e60-4e67-b17b-6a7597ae8b3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1508 microversion: 2.1 time: 0.257154 Nov 23 04:15:02.845833 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 64/127] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:02 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:02.845992 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:15:02.845992 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:15:02.860831 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-e62dedd3-e62f-412d-a6b2-c49a44fb567f req-f1480617-56d2-4053-a38c-1bfbec7985ce service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:02.861265 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-e62dedd3-e62f-412d-a6b2-c49a44fb567f req-f1480617-56d2-4053-a38c-1bfbec7985ce service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:02.872856 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-e62dedd3-e62f-412d-a6b2-c49a44fb567f req-f1480617-56d2-4053-a38c-1bfbec7985ce service nova] Creating event network-vif-plugged:1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2 for instance 8c13d4db-587d-4d4e-b8cc-23632d768572 on hv-cinder-76845 Nov 23 04:15:02.878009 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-e62dedd3-e62f-412d-a6b2-c49a44fb567f req-f1480617-56d2-4053-a38c-1bfbec7985ce service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039216 Nov 23 04:15:02.891936 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 64/128] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:15:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:15:03.068272 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f53a6d3c-afbe-4f0f-b887-a2d075a719ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:03.068272 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f53a6d3c-afbe-4f0f-b887-a2d075a719ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:03.072576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f53a6d3c-afbe-4f0f-b887-a2d075a719ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:03.073020 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f53a6d3c-afbe-4f0f-b887-a2d075a719ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:03.074379 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f53a6d3c-afbe-4f0f-b887-a2d075a719ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:03.074827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f53a6d3c-afbe-4f0f-b887-a2d075a719ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:03.111684 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-af6a0a45-187f-48f2-ba27-8ccd9fe2147f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:03.112517 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-af6a0a45-187f-48f2-ba27-8ccd9fe2147f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:03.126177 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af6a0a45-187f-48f2-ba27-8ccd9fe2147f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:03.126950 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af6a0a45-187f-48f2-ba27-8ccd9fe2147f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:03.130882 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af6a0a45-187f-48f2-ba27-8ccd9fe2147f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:03.131774 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af6a0a45-187f-48f2-ba27-8ccd9fe2147f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:03.302514 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f53a6d3c-afbe-4f0f-b887-a2d075a719ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:03.311428 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f53a6d3c-afbe-4f0f-b887-a2d075a719ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.249861 Nov 23 04:15:03.312109 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 65/129] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:03 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:03.374464 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-af6a0a45-187f-48f2-ba27-8ccd9fe2147f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:03.383533 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-af6a0a45-187f-48f2-ba27-8ccd9fe2147f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:03.385132 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-af6a0a45-187f-48f2-ba27-8ccd9fe2147f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:03.386430 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-af6a0a45-187f-48f2-ba27-8ccd9fe2147f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.279151 Nov 23 04:15:03.387194 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 65/130] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:15:03 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:15:04.328566 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4d88504f-5147-4f81-abce-c002af537700 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:04.329175 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4d88504f-5147-4f81-abce-c002af537700 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:04.335327 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d88504f-5147-4f81-abce-c002af537700 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:04.335779 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d88504f-5147-4f81-abce-c002af537700 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:04.336546 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d88504f-5147-4f81-abce-c002af537700 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:04.336974 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d88504f-5147-4f81-abce-c002af537700 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:04.406221 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3b85739c-a9e4-4238-951a-cdae416c04f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:04.406980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3b85739c-a9e4-4238-951a-cdae416c04f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:04.415577 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3b85739c-a9e4-4238-951a-cdae416c04f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:04.416661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3b85739c-a9e4-4238-951a-cdae416c04f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:04.419639 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3b85739c-a9e4-4238-951a-cdae416c04f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:04.420210 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3b85739c-a9e4-4238-951a-cdae416c04f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:04.546883 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4d88504f-5147-4f81-abce-c002af537700 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:04.554356 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4d88504f-5147-4f81-abce-c002af537700 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.229434 Nov 23 04:15:04.555104 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 66/131] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:04 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:04.625574 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3b85739c-a9e4-4238-951a-cdae416c04f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:04.634113 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3b85739c-a9e4-4238-951a-cdae416c04f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:04.636293 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3b85739c-a9e4-4238-951a-cdae416c04f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:04.640771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3b85739c-a9e4-4238-951a-cdae416c04f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.236166 Nov 23 04:15:04.641505 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 66/132] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:15:04 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:15:05.571633 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5cf12666-708f-412d-9c4c-874b053477d5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:05.572293 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5cf12666-708f-412d-9c4c-874b053477d5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:05.578559 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5cf12666-708f-412d-9c4c-874b053477d5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:05.579001 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5cf12666-708f-412d-9c4c-874b053477d5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:05.579810 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5cf12666-708f-412d-9c4c-874b053477d5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:05.580273 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5cf12666-708f-412d-9c4c-874b053477d5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:05.661922 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1073804a-3acb-41d4-b5a8-b4ec8eb5a840 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:05.662635 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1073804a-3acb-41d4-b5a8-b4ec8eb5a840 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:05.669904 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1073804a-3acb-41d4-b5a8-b4ec8eb5a840 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:05.670425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1073804a-3acb-41d4-b5a8-b4ec8eb5a840 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:05.675245 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1073804a-3acb-41d4-b5a8-b4ec8eb5a840 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:05.675245 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1073804a-3acb-41d4-b5a8-b4ec8eb5a840 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:05.723088 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5cf12666-708f-412d-9c4c-874b053477d5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:05.730795 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5cf12666-708f-412d-9c4c-874b053477d5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.162803 Nov 23 04:15:05.731590 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 67/133] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:05 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:05.813826 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1073804a-3acb-41d4-b5a8-b4ec8eb5a840 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:05.821876 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1073804a-3acb-41d4-b5a8-b4ec8eb5a840 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:05.824303 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1073804a-3acb-41d4-b5a8-b4ec8eb5a840 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:05.825342 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1073804a-3acb-41d4-b5a8-b4ec8eb5a840 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.167541 Nov 23 04:15:05.825907 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 67/134] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:15:05 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:15:06.747955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b91dc6af-4d0e-49c4-8ddf-c8099ba6d1d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:06.747955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b91dc6af-4d0e-49c4-8ddf-c8099ba6d1d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:06.754229 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b91dc6af-4d0e-49c4-8ddf-c8099ba6d1d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:06.764112 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b91dc6af-4d0e-49c4-8ddf-c8099ba6d1d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:06.764112 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b91dc6af-4d0e-49c4-8ddf-c8099ba6d1d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:06.764112 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b91dc6af-4d0e-49c4-8ddf-c8099ba6d1d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:06.843672 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0e05de54-3951-4736-96c5-5e14658109ab tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:06.844277 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0e05de54-3951-4736-96c5-5e14658109ab tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:06.850361 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e05de54-3951-4736-96c5-5e14658109ab tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:06.851012 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e05de54-3951-4736-96c5-5e14658109ab tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:06.851951 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e05de54-3951-4736-96c5-5e14658109ab tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:06.852676 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e05de54-3951-4736-96c5-5e14658109ab tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:06.905514 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b91dc6af-4d0e-49c4-8ddf-c8099ba6d1d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:06.913487 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b91dc6af-4d0e-49c4-8ddf-c8099ba6d1d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.169281 Nov 23 04:15:06.914231 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 68/135] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:06 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:06.998688 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0e05de54-3951-4736-96c5-5e14658109ab tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:07.006827 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0e05de54-3951-4736-96c5-5e14658109ab tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:07.008357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0e05de54-3951-4736-96c5-5e14658109ab tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:07.009443 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0e05de54-3951-4736-96c5-5e14658109ab tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.170183 Nov 23 04:15:07.009994 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 68/136] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:15:06 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:15:07.934966 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-eafa9399-1ee9-43d2-9f9e-c8090f7122ea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:07.934966 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-eafa9399-1ee9-43d2-9f9e-c8090f7122ea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:07.939590 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eafa9399-1ee9-43d2-9f9e-c8090f7122ea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:07.941006 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eafa9399-1ee9-43d2-9f9e-c8090f7122ea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:07.944316 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eafa9399-1ee9-43d2-9f9e-c8090f7122ea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:07.945361 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eafa9399-1ee9-43d2-9f9e-c8090f7122ea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:08.031603 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-99d263fd-a204-4fec-aa61-03a300de6113 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:08.032523 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-99d263fd-a204-4fec-aa61-03a300de6113 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:08.038455 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d263fd-a204-4fec-aa61-03a300de6113 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:08.039060 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d263fd-a204-4fec-aa61-03a300de6113 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:08.043896 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d263fd-a204-4fec-aa61-03a300de6113 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:08.043896 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d263fd-a204-4fec-aa61-03a300de6113 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:08.135906 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-eafa9399-1ee9-43d2-9f9e-c8090f7122ea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:08.145423 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-eafa9399-1ee9-43d2-9f9e-c8090f7122ea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.219109 Nov 23 04:15:08.146098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 69/137] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:07 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:08.226414 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-99d263fd-a204-4fec-aa61-03a300de6113 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:08.242233 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-99d263fd-a204-4fec-aa61-03a300de6113 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:08.243960 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-99d263fd-a204-4fec-aa61-03a300de6113 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:08.245048 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-99d263fd-a204-4fec-aa61-03a300de6113 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1403 microversion: 2.20 time: 0.220680 Nov 23 04:15:08.251525 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 69/138] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:15:08 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1403 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:15:08.469191 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c80e9502-f7c8-4558-bd9f-5211189d1d86 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "755af238-1d3c-437d-8c92-f5c58111206e"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:08.472520 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c80e9502-f7c8-4558-bd9f-5211189d1d86 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:08.480641 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c80e9502-f7c8-4558-bd9f-5211189d1d86 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:08.481318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c80e9502-f7c8-4558-bd9f-5211189d1d86 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:08.482183 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c80e9502-f7c8-4558-bd9f-5211189d1d86 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:08.482819 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c80e9502-f7c8-4558-bd9f-5211189d1d86 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:08.530175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-888cfe30-679a-441d-a9c2-78e348d37fbd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51863c1b-92bb-428a-b625-5f063e1c3714"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:08.531265 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-888cfe30-679a-441d-a9c2-78e348d37fbd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:08.537440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-888cfe30-679a-441d-a9c2-78e348d37fbd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:08.537888 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-888cfe30-679a-441d-a9c2-78e348d37fbd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:08.538714 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-888cfe30-679a-441d-a9c2-78e348d37fbd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:08.539150 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-888cfe30-679a-441d-a9c2-78e348d37fbd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:09.895596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c80e9502-f7c8-4558-bd9f-5211189d1d86 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "POST /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.430142 Nov 23 04:15:09.896281 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 70/139] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:15:08 2021] POST /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5/os-volume_attachments => generated 194 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:15:09.901491 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-6684dab1-d026-4e35-b8d2-8d0ff282bdf3 req-f3efd003-79a5-48af-a587-2a521c906ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6648b45-9a0f-4dd2-8a71-d53921d23d91", "name": "network-vif-plugged", "status": "completed", "tag": "6a7ea38e-87d3-4079-a13a-d1258a7c04f9"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:09.903286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:15:09.903286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:15:09.910926 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-6684dab1-d026-4e35-b8d2-8d0ff282bdf3 req-f3efd003-79a5-48af-a587-2a521c906ba3 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:09.911420 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-6684dab1-d026-4e35-b8d2-8d0ff282bdf3 req-f3efd003-79a5-48af-a587-2a521c906ba3 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:09.924619 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-6684dab1-d026-4e35-b8d2-8d0ff282bdf3 req-f3efd003-79a5-48af-a587-2a521c906ba3 service nova] Creating event network-vif-plugged:6a7ea38e-87d3-4079-a13a-d1258a7c04f9 for instance e6648b45-9a0f-4dd2-8a71-d53921d23d91 on hv-cinder-76845 Nov 23 04:15:09.927771 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-6684dab1-d026-4e35-b8d2-8d0ff282bdf3 req-f3efd003-79a5-48af-a587-2a521c906ba3 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030035 Nov 23 04:15:09.928747 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 71/140] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:15:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:15:09.934302 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f860c642-b69e-4212-a3a2-a73abb122b44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:09.935046 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f860c642-b69e-4212-a3a2-a73abb122b44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:09.941712 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f860c642-b69e-4212-a3a2-a73abb122b44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:09.942168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f860c642-b69e-4212-a3a2-a73abb122b44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:09.942968 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f860c642-b69e-4212-a3a2-a73abb122b44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:09.943442 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f860c642-b69e-4212-a3a2-a73abb122b44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:10.085088 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f860c642-b69e-4212-a3a2-a73abb122b44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:10.092371 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f860c642-b69e-4212-a3a2-a73abb122b44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.162465 Nov 23 04:15:10.092942 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 72/141] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:09 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:10.097340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-04cbf6f0-e874-4749-9332-63fa0c297934 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:10.097942 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-04cbf6f0-e874-4749-9332-63fa0c297934 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:10.103637 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04cbf6f0-e874-4749-9332-63fa0c297934 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:10.104094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04cbf6f0-e874-4749-9332-63fa0c297934 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:10.104972 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04cbf6f0-e874-4749-9332-63fa0c297934 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:10.105465 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04cbf6f0-e874-4749-9332-63fa0c297934 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:10.241003 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-04cbf6f0-e874-4749-9332-63fa0c297934 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:10.251085 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-04cbf6f0-e874-4749-9332-63fa0c297934 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:10.252623 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-04cbf6f0-e874-4749-9332-63fa0c297934 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:10.253791 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-04cbf6f0-e874-4749-9332-63fa0c297934 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1595 microversion: 2.20 time: 0.159896 Nov 23 04:15:10.254358 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 73/142] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:15:10 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:15:10.272416 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-96da9f1b-59bb-4998-841d-748c5ce23cac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:10.272900 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-96da9f1b-59bb-4998-841d-748c5ce23cac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:10.278843 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-96da9f1b-59bb-4998-841d-748c5ce23cac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:10.279271 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-96da9f1b-59bb-4998-841d-748c5ce23cac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:10.280049 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-96da9f1b-59bb-4998-841d-748c5ce23cac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:10.280491 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-96da9f1b-59bb-4998-841d-748c5ce23cac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:10.362302 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-96da9f1b-59bb-4998-841d-748c5ce23cac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093637 Nov 23 04:15:10.362910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 74/143] 10.222.0.54 () {60 vars in 1315 bytes} [Tue Nov 23 04:15:10 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:15:10.614400 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-888cfe30-679a-441d-a9c2-78e348d37fbd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "POST /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.088265 Nov 23 04:15:10.619516 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 70/144] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:15:08 2021] POST /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c/os-volume_attachments => generated 194 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:15:11.109473 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5736b75b-db22-4129-ab64-6502ce6d71fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:11.110319 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5736b75b-db22-4129-ab64-6502ce6d71fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:11.116313 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5736b75b-db22-4129-ab64-6502ce6d71fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:11.116863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5736b75b-db22-4129-ab64-6502ce6d71fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:11.117676 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5736b75b-db22-4129-ab64-6502ce6d71fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:11.118113 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5736b75b-db22-4129-ab64-6502ce6d71fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:11.263016 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5736b75b-db22-4129-ab64-6502ce6d71fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:11.270129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5736b75b-db22-4129-ab64-6502ce6d71fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.164830 Nov 23 04:15:11.270702 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 75/145] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:11 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:11.869262 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a48971f9-c3eb-4ea1-ae24-d8c006366099 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:11.871710 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a48971f9-c3eb-4ea1-ae24-d8c006366099 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:11.876999 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-2a19b99f-b871-48e4-b284-2d32e80d8d78 req-3a1b47fb-094f-4386-a96a-ee16b24a0c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c13d4db-587d-4d4e-b8cc-23632d768572", "tag": "1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:11.878652 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:15:11.878652 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:15:11.879810 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a48971f9-c3eb-4ea1-ae24-d8c006366099 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:11.880812 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a48971f9-c3eb-4ea1-ae24-d8c006366099 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:11.882303 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a48971f9-c3eb-4ea1-ae24-d8c006366099 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:11.882957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a48971f9-c3eb-4ea1-ae24-d8c006366099 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:11.886126 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-2a19b99f-b871-48e4-b284-2d32e80d8d78 req-3a1b47fb-094f-4386-a96a-ee16b24a0c2a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:11.886578 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-2a19b99f-b871-48e4-b284-2d32e80d8d78 req-3a1b47fb-094f-4386-a96a-ee16b24a0c2a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:11.912555 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-2a19b99f-b871-48e4-b284-2d32e80d8d78 req-3a1b47fb-094f-4386-a96a-ee16b24a0c2a service nova] Creating event network-changed:1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2 for instance 8c13d4db-587d-4d4e-b8cc-23632d768572 on hv-cinder-76845 Nov 23 04:15:11.926175 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-2a19b99f-b871-48e4-b284-2d32e80d8d78 req-3a1b47fb-094f-4386-a96a-ee16b24a0c2a service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052449 Nov 23 04:15:11.927427 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 76/146] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:15:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:15:12.171028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a48971f9-c3eb-4ea1-ae24-d8c006366099 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 0.306145 Nov 23 04:15:12.174308 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 71/147] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:11 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:12.288521 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-be26ab5b-c7db-44b7-abc3-ac6cc386a589 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:12.293477 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-be26ab5b-c7db-44b7-abc3-ac6cc386a589 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:12.305698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be26ab5b-c7db-44b7-abc3-ac6cc386a589 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:12.306226 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be26ab5b-c7db-44b7-abc3-ac6cc386a589 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:12.309315 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be26ab5b-c7db-44b7-abc3-ac6cc386a589 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:12.309651 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be26ab5b-c7db-44b7-abc3-ac6cc386a589 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:12.616366 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-be26ab5b-c7db-44b7-abc3-ac6cc386a589 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:12.624594 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-be26ab5b-c7db-44b7-abc3-ac6cc386a589 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1322 microversion: 2.1 time: 0.340248 Nov 23 04:15:12.625177 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 77/148] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:12 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:13.182296 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-44ea16b8-efa4-4adc-bc5e-01bc8cc1a079 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:13.183835 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-44ea16b8-efa4-4adc-bc5e-01bc8cc1a079 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:13.190651 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44ea16b8-efa4-4adc-bc5e-01bc8cc1a079 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:13.191103 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44ea16b8-efa4-4adc-bc5e-01bc8cc1a079 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:13.191928 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44ea16b8-efa4-4adc-bc5e-01bc8cc1a079 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:13.192356 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44ea16b8-efa4-4adc-bc5e-01bc8cc1a079 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:13.305652 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-44ea16b8-efa4-4adc-bc5e-01bc8cc1a079 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 0.127302 Nov 23 04:15:13.306283 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 72/149] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:13 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:13.641560 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0870385a-a61a-43e9-8e9d-7c5cfd40cd5a tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:13.642778 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0870385a-a61a-43e9-8e9d-7c5cfd40cd5a tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:13.649408 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0870385a-a61a-43e9-8e9d-7c5cfd40cd5a tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:13.649747 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0870385a-a61a-43e9-8e9d-7c5cfd40cd5a tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:13.650552 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0870385a-a61a-43e9-8e9d-7c5cfd40cd5a tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:13.651023 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0870385a-a61a-43e9-8e9d-7c5cfd40cd5a tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:13.788038 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0870385a-a61a-43e9-8e9d-7c5cfd40cd5a tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:13.798439 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0870385a-a61a-43e9-8e9d-7c5cfd40cd5a tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1515 microversion: 2.1 time: 0.160635 Nov 23 04:15:13.803276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 78/150] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:13 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:13.821634 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b44752ae-5947-45f1-a9d4-d633ead1de90 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:13.822876 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b44752ae-5947-45f1-a9d4-d633ead1de90 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:13.830423 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b44752ae-5947-45f1-a9d4-d633ead1de90 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:13.830889 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b44752ae-5947-45f1-a9d4-d633ead1de90 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:13.831689 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b44752ae-5947-45f1-a9d4-d633ead1de90 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:13.832121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b44752ae-5947-45f1-a9d4-d633ead1de90 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:13.855255 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-b44752ae-5947-45f1-a9d4-d633ead1de90 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lazy-loading 'flavor' on Instance uuid e6648b45-9a0f-4dd2-8a71-d53921d23d91 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:15:14.204768 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b44752ae-5947-45f1-a9d4-d633ead1de90 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "POST /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91/action" status: 200 len: 32 microversion: 2.1 time: 0.387204 Nov 23 04:15:14.205700 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 73/151] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:15:13 2021] POST /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91/action => generated 32 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:15:14.214720 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c76786b4-64cd-4b48-8ed1-052cd2562329 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:14.215360 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c76786b4-64cd-4b48-8ed1-052cd2562329 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:14.221242 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c76786b4-64cd-4b48-8ed1-052cd2562329 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:14.221686 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c76786b4-64cd-4b48-8ed1-052cd2562329 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:14.222455 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c76786b4-64cd-4b48-8ed1-052cd2562329 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:14.222885 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c76786b4-64cd-4b48-8ed1-052cd2562329 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:14.317825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7824c979-b465-43e4-b261-d8412d2930d8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:14.318856 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7824c979-b465-43e4-b261-d8412d2930d8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:14.326411 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7824c979-b465-43e4-b261-d8412d2930d8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:14.326865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7824c979-b465-43e4-b261-d8412d2930d8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:14.327707 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7824c979-b465-43e4-b261-d8412d2930d8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:14.328148 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7824c979-b465-43e4-b261-d8412d2930d8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:14.359475 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c76786b4-64cd-4b48-8ed1-052cd2562329 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:14.367482 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c76786b4-64cd-4b48-8ed1-052cd2562329 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.156885 Nov 23 04:15:14.368064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 79/152] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:14 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:14.455656 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7824c979-b465-43e4-b261-d8412d2930d8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 0.141673 Nov 23 04:15:14.458848 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 74/153] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:14 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:15.385103 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-691f3868-9d16-4cf0-a065-fa2ecf79a562 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:15.385699 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-691f3868-9d16-4cf0-a065-fa2ecf79a562 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:15.392555 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-691f3868-9d16-4cf0-a065-fa2ecf79a562 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:15.393001 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-691f3868-9d16-4cf0-a065-fa2ecf79a562 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:15.393781 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-691f3868-9d16-4cf0-a065-fa2ecf79a562 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:15.394217 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-691f3868-9d16-4cf0-a065-fa2ecf79a562 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:15.467018 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1c43f228-ab2c-4e98-92a5-507a8da0f3fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:15.468532 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1c43f228-ab2c-4e98-92a5-507a8da0f3fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:15.475945 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1c43f228-ab2c-4e98-92a5-507a8da0f3fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:15.477406 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1c43f228-ab2c-4e98-92a5-507a8da0f3fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:15.478832 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1c43f228-ab2c-4e98-92a5-507a8da0f3fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:15.479544 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1c43f228-ab2c-4e98-92a5-507a8da0f3fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:15.561600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-691f3868-9d16-4cf0-a065-fa2ecf79a562 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:15.569584 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-691f3868-9d16-4cf0-a065-fa2ecf79a562 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.188216 Nov 23 04:15:15.571262 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 80/154] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:15 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:15.621005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1c43f228-ab2c-4e98-92a5-507a8da0f3fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 0.149729 Nov 23 04:15:15.621005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 75/155] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:15 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:16.590014 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4fa9b5d6-c8e1-4e77-8849-2e08297e29ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:16.593442 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4fa9b5d6-c8e1-4e77-8849-2e08297e29ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:16.596786 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4fa9b5d6-c8e1-4e77-8849-2e08297e29ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:16.597230 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4fa9b5d6-c8e1-4e77-8849-2e08297e29ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:16.598006 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4fa9b5d6-c8e1-4e77-8849-2e08297e29ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:16.598428 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4fa9b5d6-c8e1-4e77-8849-2e08297e29ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:16.625275 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d737e2bd-c468-4539-8efe-d41066687814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:16.626289 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d737e2bd-c468-4539-8efe-d41066687814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:16.632753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d737e2bd-c468-4539-8efe-d41066687814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:16.634527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d737e2bd-c468-4539-8efe-d41066687814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:16.634527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d737e2bd-c468-4539-8efe-d41066687814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:16.634527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d737e2bd-c468-4539-8efe-d41066687814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:16.739470 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d737e2bd-c468-4539-8efe-d41066687814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 0.118985 Nov 23 04:15:16.740421 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 76/156] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:16 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:16.765622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4fa9b5d6-c8e1-4e77-8849-2e08297e29ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:16.774994 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4fa9b5d6-c8e1-4e77-8849-2e08297e29ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.189057 Nov 23 04:15:16.780375 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 81/157] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:16 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:17.750952 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-00d805a2-2702-40c7-84f2-43a2e3ac3500 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:17.752526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-00d805a2-2702-40c7-84f2-43a2e3ac3500 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:17.759098 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-00d805a2-2702-40c7-84f2-43a2e3ac3500 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:17.759588 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-00d805a2-2702-40c7-84f2-43a2e3ac3500 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:17.760407 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-00d805a2-2702-40c7-84f2-43a2e3ac3500 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:17.761047 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-00d805a2-2702-40c7-84f2-43a2e3ac3500 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:17.797509 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-46ef4425-bb95-4a76-8387-41a8ac958803 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:17.798780 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-46ef4425-bb95-4a76-8387-41a8ac958803 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:17.805129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-46ef4425-bb95-4a76-8387-41a8ac958803 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:17.805572 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-46ef4425-bb95-4a76-8387-41a8ac958803 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:17.806419 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-46ef4425-bb95-4a76-8387-41a8ac958803 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:17.806848 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-46ef4425-bb95-4a76-8387-41a8ac958803 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:17.866369 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-00d805a2-2702-40c7-84f2-43a2e3ac3500 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 0.119235 Nov 23 04:15:17.867075 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 77/158] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:17 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:17.947403 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-46ef4425-bb95-4a76-8387-41a8ac958803 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:17.955856 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-46ef4425-bb95-4a76-8387-41a8ac958803 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.161876 Nov 23 04:15:17.956567 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 82/159] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:17 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:18.878780 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c854d4ab-c936-4736-8898-4ac92439df3c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:18.888962 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c854d4ab-c936-4736-8898-4ac92439df3c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:18.888962 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c854d4ab-c936-4736-8898-4ac92439df3c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:18.888962 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c854d4ab-c936-4736-8898-4ac92439df3c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:18.889374 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c854d4ab-c936-4736-8898-4ac92439df3c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:18.889807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c854d4ab-c936-4736-8898-4ac92439df3c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:18.972945 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-83eb8939-f2fa-4331-b297-af6a6f7afbd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:18.973676 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-83eb8939-f2fa-4331-b297-af6a6f7afbd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:18.981049 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-83eb8939-f2fa-4331-b297-af6a6f7afbd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:18.981495 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-83eb8939-f2fa-4331-b297-af6a6f7afbd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:18.982267 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-83eb8939-f2fa-4331-b297-af6a6f7afbd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:18.982697 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-83eb8939-f2fa-4331-b297-af6a6f7afbd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:19.130210 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-83eb8939-f2fa-4331-b297-af6a6f7afbd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:19.139004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-83eb8939-f2fa-4331-b297-af6a6f7afbd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.169798 Nov 23 04:15:19.139844 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 83/160] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:18 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:20.158042 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fbc4c517-742e-4c20-b8e3-c5d1e360f201 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:20.158751 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fbc4c517-742e-4c20-b8e3-c5d1e360f201 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:20.165273 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fbc4c517-742e-4c20-b8e3-c5d1e360f201 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:20.165801 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fbc4c517-742e-4c20-b8e3-c5d1e360f201 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:20.166640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fbc4c517-742e-4c20-b8e3-c5d1e360f201 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:20.167177 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fbc4c517-742e-4c20-b8e3-c5d1e360f201 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:20.310408 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-fbc4c517-742e-4c20-b8e3-c5d1e360f201 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:20.318023 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fbc4c517-742e-4c20-b8e3-c5d1e360f201 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.163348 Nov 23 04:15:20.318843 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 84/161] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:20 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:21.017658 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c854d4ab-c936-4736-8898-4ac92439df3c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 2.143687 Nov 23 04:15:21.018382 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 78/162] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:18 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:21.334490 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b0feab09-3b0a-4a4d-b7e4-24a66c418312 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:21.335344 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b0feab09-3b0a-4a4d-b7e4-24a66c418312 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:21.341652 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b0feab09-3b0a-4a4d-b7e4-24a66c418312 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:21.348434 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b0feab09-3b0a-4a4d-b7e4-24a66c418312 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:21.348434 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b0feab09-3b0a-4a4d-b7e4-24a66c418312 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:21.348434 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b0feab09-3b0a-4a4d-b7e4-24a66c418312 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:21.504120 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b0feab09-3b0a-4a4d-b7e4-24a66c418312 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:21.511545 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b0feab09-3b0a-4a4d-b7e4-24a66c418312 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.180606 Nov 23 04:15:21.512115 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 85/163] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:21 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:22.030335 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-68141439-3542-43ef-85a0-c0980d89886d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:22.031915 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-68141439-3542-43ef-85a0-c0980d89886d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:22.039857 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-68141439-3542-43ef-85a0-c0980d89886d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:22.040578 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-68141439-3542-43ef-85a0-c0980d89886d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:22.041388 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-68141439-3542-43ef-85a0-c0980d89886d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:22.041821 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-68141439-3542-43ef-85a0-c0980d89886d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:22.156925 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-68141439-3542-43ef-85a0-c0980d89886d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 0.131633 Nov 23 04:15:22.160237 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 79/164] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:22 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:22.529165 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5428d8eb-ad0f-485f-9f6d-886518ba9e6f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:22.531396 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5428d8eb-ad0f-485f-9f6d-886518ba9e6f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:22.536168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5428d8eb-ad0f-485f-9f6d-886518ba9e6f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:22.536645 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5428d8eb-ad0f-485f-9f6d-886518ba9e6f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:22.537417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5428d8eb-ad0f-485f-9f6d-886518ba9e6f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:22.537845 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5428d8eb-ad0f-485f-9f6d-886518ba9e6f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:22.679492 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5428d8eb-ad0f-485f-9f6d-886518ba9e6f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:22.690417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5428d8eb-ad0f-485f-9f6d-886518ba9e6f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.165514 Nov 23 04:15:22.705467 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 86/165] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:22 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:23.168239 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-667e09e6-1743-4877-b068-c4b4f9382889 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:23.169550 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-667e09e6-1743-4877-b068-c4b4f9382889 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:23.176704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-667e09e6-1743-4877-b068-c4b4f9382889 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:23.177229 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-667e09e6-1743-4877-b068-c4b4f9382889 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:23.178010 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-667e09e6-1743-4877-b068-c4b4f9382889 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:23.178438 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-667e09e6-1743-4877-b068-c4b4f9382889 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:23.322322 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-667e09e6-1743-4877-b068-c4b4f9382889 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 0.158217 Nov 23 04:15:23.325880 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 80/166] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:23 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:23.709612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-06b7f6d8-01ae-4260-b58c-05143e2cc8ba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:23.710221 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-06b7f6d8-01ae-4260-b58c-05143e2cc8ba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:23.716494 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-06b7f6d8-01ae-4260-b58c-05143e2cc8ba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:23.716930 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-06b7f6d8-01ae-4260-b58c-05143e2cc8ba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:23.722854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-06b7f6d8-01ae-4260-b58c-05143e2cc8ba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:23.722854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-06b7f6d8-01ae-4260-b58c-05143e2cc8ba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:23.850288 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-06b7f6d8-01ae-4260-b58c-05143e2cc8ba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:23.858600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-06b7f6d8-01ae-4260-b58c-05143e2cc8ba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.152566 Nov 23 04:15:23.868220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 87/167] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:23 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:24.334169 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-baf6f0e9-04dd-4be6-bf8c-9dbef23d0887 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:24.335150 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-baf6f0e9-04dd-4be6-bf8c-9dbef23d0887 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:24.342413 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-baf6f0e9-04dd-4be6-bf8c-9dbef23d0887 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:24.342856 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-baf6f0e9-04dd-4be6-bf8c-9dbef23d0887 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:24.343654 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-baf6f0e9-04dd-4be6-bf8c-9dbef23d0887 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:24.344083 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-baf6f0e9-04dd-4be6-bf8c-9dbef23d0887 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:24.458822 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-baf6f0e9-04dd-4be6-bf8c-9dbef23d0887 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 0.128464 Nov 23 04:15:24.462306 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 81/168] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:24 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:24.519943 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c20364e6-1782-4978-ac62-d8d13ff0733c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:24.520409 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c20364e6-1782-4978-ac62-d8d13ff0733c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:24.527053 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c20364e6-1782-4978-ac62-d8d13ff0733c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:24.527722 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c20364e6-1782-4978-ac62-d8d13ff0733c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:24.528501 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c20364e6-1782-4978-ac62-d8d13ff0733c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:24.528942 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c20364e6-1782-4978-ac62-d8d13ff0733c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:24.553992 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c20364e6-1782-4978-ac62-d8d13ff0733c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:15:24.875716 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-792446a8-47ee-49b6-bc8a-50890ce50f8d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:24.876986 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-792446a8-47ee-49b6-bc8a-50890ce50f8d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:24.883767 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-792446a8-47ee-49b6-bc8a-50890ce50f8d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:24.884225 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-792446a8-47ee-49b6-bc8a-50890ce50f8d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:24.885014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-792446a8-47ee-49b6-bc8a-50890ce50f8d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:24.885451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-792446a8-47ee-49b6-bc8a-50890ce50f8d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:24.932226 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c20364e6-1782-4978-ac62-d8d13ff0733c tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "DELETE /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 204 len: 0 microversion: 2.1 time: 0.415728 Nov 23 04:15:24.933450 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 88/169] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:15:24 2021] DELETE /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:15:24.941706 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bb5e833b-c428-4a19-858e-cf1480e2aa29 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:24.942427 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bb5e833b-c428-4a19-858e-cf1480e2aa29 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:24.949657 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb5e833b-c428-4a19-858e-cf1480e2aa29 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:24.950139 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb5e833b-c428-4a19-858e-cf1480e2aa29 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:24.950912 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb5e833b-c428-4a19-858e-cf1480e2aa29 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:24.951393 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb5e833b-c428-4a19-858e-cf1480e2aa29 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:25.063434 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-792446a8-47ee-49b6-bc8a-50890ce50f8d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:25.072175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-792446a8-47ee-49b6-bc8a-50890ce50f8d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.200341 Nov 23 04:15:25.072853 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 82/170] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:24 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:25.128863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-bb5e833b-c428-4a19-858e-cf1480e2aa29 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:25.136798 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bb5e833b-c428-4a19-858e-cf1480e2aa29 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1552 microversion: 2.1 time: 0.198975 Nov 23 04:15:25.137375 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 89/171] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:24 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1552 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:25.470485 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2d2be68a-553a-4d59-8719-b3e4ff2216c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:25.471430 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2d2be68a-553a-4d59-8719-b3e4ff2216c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:25.477779 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d2be68a-553a-4d59-8719-b3e4ff2216c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:25.478229 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d2be68a-553a-4d59-8719-b3e4ff2216c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:25.479015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d2be68a-553a-4d59-8719-b3e4ff2216c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:25.479559 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d2be68a-553a-4d59-8719-b3e4ff2216c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:25.612088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2d2be68a-553a-4d59-8719-b3e4ff2216c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 14 microversion: 2.20 time: 0.145202 Nov 23 04:15:25.612795 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 83/172] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:25 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:26.089563 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-22a58611-b0d5-4fe7-ad05-6028537a8560 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:26.090733 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-22a58611-b0d5-4fe7-ad05-6028537a8560 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:26.097310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-22a58611-b0d5-4fe7-ad05-6028537a8560 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:26.097852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-22a58611-b0d5-4fe7-ad05-6028537a8560 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:26.098894 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-22a58611-b0d5-4fe7-ad05-6028537a8560 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:26.099507 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-22a58611-b0d5-4fe7-ad05-6028537a8560 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:26.155413 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-751ccc7f-542c-478e-aa6d-1967ae36f1ff tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:26.156326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-751ccc7f-542c-478e-aa6d-1967ae36f1ff tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:26.163713 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-751ccc7f-542c-478e-aa6d-1967ae36f1ff tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:26.164561 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-751ccc7f-542c-478e-aa6d-1967ae36f1ff tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:26.165804 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-751ccc7f-542c-478e-aa6d-1967ae36f1ff tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:26.166421 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-751ccc7f-542c-478e-aa6d-1967ae36f1ff tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:26.315583 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-22a58611-b0d5-4fe7-ad05-6028537a8560 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:26.322944 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-22a58611-b0d5-4fe7-ad05-6028537a8560 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.237528 Nov 23 04:15:26.323723 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 90/173] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:26 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:26.369213 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-751ccc7f-542c-478e-aa6d-1967ae36f1ff tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:26.378478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-751ccc7f-542c-478e-aa6d-1967ae36f1ff tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1552 microversion: 2.1 time: 0.227921 Nov 23 04:15:26.379581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 84/174] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:26 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1552 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:26.622465 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-57ceb1a1-9b11-4484-b724-74b56cb03e6a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:26.623451 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-57ceb1a1-9b11-4484-b724-74b56cb03e6a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:26.629167 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-57ceb1a1-9b11-4484-b724-74b56cb03e6a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:26.629694 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-57ceb1a1-9b11-4484-b724-74b56cb03e6a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:26.630465 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-57ceb1a1-9b11-4484-b724-74b56cb03e6a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:26.630899 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-57ceb1a1-9b11-4484-b724-74b56cb03e6a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:26.759553 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-57ceb1a1-9b11-4484-b724-74b56cb03e6a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 4646 microversion: 2.20 time: 0.141075 Nov 23 04:15:26.760399 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 91/175] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:26 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 4646 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:15:27.340573 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-af105270-498a-41ec-bf49-0c2e483cbc47 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:27.341182 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-af105270-498a-41ec-bf49-0c2e483cbc47 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:27.347542 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af105270-498a-41ec-bf49-0c2e483cbc47 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:27.347991 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af105270-498a-41ec-bf49-0c2e483cbc47 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:27.348920 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af105270-498a-41ec-bf49-0c2e483cbc47 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:27.349364 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af105270-498a-41ec-bf49-0c2e483cbc47 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:27.396588 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6f692de7-d73b-4a93-b3a7-b4681f8855dc tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:27.397289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6f692de7-d73b-4a93-b3a7-b4681f8855dc tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:27.404923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f692de7-d73b-4a93-b3a7-b4681f8855dc tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:27.405369 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f692de7-d73b-4a93-b3a7-b4681f8855dc tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:27.406156 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f692de7-d73b-4a93-b3a7-b4681f8855dc tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:27.406587 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f692de7-d73b-4a93-b3a7-b4681f8855dc tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:27.541375 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-af105270-498a-41ec-bf49-0c2e483cbc47 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:27.550315 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-af105270-498a-41ec-bf49-0c2e483cbc47 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.213891 Nov 23 04:15:27.550969 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 85/176] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:27 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:27.588479 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6f692de7-d73b-4a93-b3a7-b4681f8855dc tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:27.597138 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6f692de7-d73b-4a93-b3a7-b4681f8855dc tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1552 microversion: 2.1 time: 0.204496 Nov 23 04:15:27.598653 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 92/177] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:27 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1552 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:27.771685 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-418c798f-7ec2-4f17-bd6a-6a23c041e276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:27.773654 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-418c798f-7ec2-4f17-bd6a-6a23c041e276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:27.791746 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-418c798f-7ec2-4f17-bd6a-6a23c041e276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:27.792525 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-418c798f-7ec2-4f17-bd6a-6a23c041e276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:27.793678 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-418c798f-7ec2-4f17-bd6a-6a23c041e276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:27.794302 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-418c798f-7ec2-4f17-bd6a-6a23c041e276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:27.920946 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-418c798f-7ec2-4f17-bd6a-6a23c041e276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 10830 microversion: 2.20 time: 0.154056 Nov 23 04:15:27.923002 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 86/178] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:27 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 10830 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:15:28.568136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ca47f7ad-c2f4-4ba5-b64b-7cc6478b3e72 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:28.569206 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ca47f7ad-c2f4-4ba5-b64b-7cc6478b3e72 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:28.578602 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca47f7ad-c2f4-4ba5-b64b-7cc6478b3e72 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:28.579111 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca47f7ad-c2f4-4ba5-b64b-7cc6478b3e72 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:28.579912 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca47f7ad-c2f4-4ba5-b64b-7cc6478b3e72 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:28.580349 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca47f7ad-c2f4-4ba5-b64b-7cc6478b3e72 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:28.614898 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-14e6a770-f6df-40c7-b7af-95aab01be6f9 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:28.615938 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-14e6a770-f6df-40c7-b7af-95aab01be6f9 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:28.624459 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-14e6a770-f6df-40c7-b7af-95aab01be6f9 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:28.625023 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-14e6a770-f6df-40c7-b7af-95aab01be6f9 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:28.626164 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-14e6a770-f6df-40c7-b7af-95aab01be6f9 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:28.627172 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-14e6a770-f6df-40c7-b7af-95aab01be6f9 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:28.767198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-14e6a770-f6df-40c7-b7af-95aab01be6f9 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:28.777216 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-14e6a770-f6df-40c7-b7af-95aab01be6f9 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1510 microversion: 2.1 time: 0.167018 Nov 23 04:15:28.777805 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 87/179] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:28 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:28.791506 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-ee5c9a37-34a6-419e-829b-94ad4796b5ca req-9fe175db-870e-4ca0-b921-feabfc631a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e50b4e8-8b55-4abf-b356-7e130ff4c5a5", "name": "network-vif-deleted", "tag": "5802ea66-681d-4f76-a561-6e2e0d2de725"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:28.793261 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:15:28.793261 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:15:28.801576 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-ee5c9a37-34a6-419e-829b-94ad4796b5ca req-9fe175db-870e-4ca0-b921-feabfc631a12 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:28.801576 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-ee5c9a37-34a6-419e-829b-94ad4796b5ca req-9fe175db-870e-4ca0-b921-feabfc631a12 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:28.814316 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-ee5c9a37-34a6-419e-829b-94ad4796b5ca req-9fe175db-870e-4ca0-b921-feabfc631a12 service nova] Creating event network-vif-deleted:5802ea66-681d-4f76-a561-6e2e0d2de725 for instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 on hv-cinder-76845 Nov 23 04:15:28.821393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-ee5c9a37-34a6-419e-829b-94ad4796b5ca req-9fe175db-870e-4ca0-b921-feabfc631a12 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038668 Nov 23 04:15:28.822038 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 88/180] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:15:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:15:28.877192 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ca47f7ad-c2f4-4ba5-b64b-7cc6478b3e72 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:28.886268 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ca47f7ad-c2f4-4ba5-b64b-7cc6478b3e72 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.321197 Nov 23 04:15:28.887373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 93/181] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:28 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:28.936166 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6712e4b9-67f3-4d2c-b685-19ae52313dfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:28.937245 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6712e4b9-67f3-4d2c-b685-19ae52313dfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:28.946892 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6712e4b9-67f3-4d2c-b685-19ae52313dfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:28.947584 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6712e4b9-67f3-4d2c-b685-19ae52313dfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:28.948999 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6712e4b9-67f3-4d2c-b685-19ae52313dfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:28.950927 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6712e4b9-67f3-4d2c-b685-19ae52313dfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:29.106409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6712e4b9-67f3-4d2c-b685-19ae52313dfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 15412 microversion: 2.20 time: 0.176152 Nov 23 04:15:29.107395 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 89/182] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:28 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 15412 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:29.795405 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:29.796034 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:29.802423 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:29.802875 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:29.814443 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:29.814443 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:29.849998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:29.850449 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:29.850931 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lazy-loading 'fault' on Instance uuid 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:15:29.899106 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c04ecf61bb2468a99223a57cb41fd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04145637610344c69dd78ebf3ecd92ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:29.905656 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8d8aa55e-8e05-4ff1-be9a-7c495a58df17 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:29.907189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8d8aa55e-8e05-4ff1-be9a-7c495a58df17 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:29.918452 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7ebb044d-15a1-4581-936b-75832d5016c4 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 200 len: 1350 microversion: 2.1 time: 0.126690 Nov 23 04:15:29.919357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8d8aa55e-8e05-4ff1-be9a-7c495a58df17 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:29.919819 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8d8aa55e-8e05-4ff1-be9a-7c495a58df17 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:29.920170 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 94/183] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:29 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 1350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:29.920632 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8d8aa55e-8e05-4ff1-be9a-7c495a58df17 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:29.921065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8d8aa55e-8e05-4ff1-be9a-7c495a58df17 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:30.080311 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8d8aa55e-8e05-4ff1-be9a-7c495a58df17 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:30.089494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8d8aa55e-8e05-4ff1-be9a-7c495a58df17 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.186760 Nov 23 04:15:30.090161 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 90/184] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:29 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:30.117978 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8e53b677-0633-4034-a7f8-d3ee3bab51cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:30.118778 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8e53b677-0633-4034-a7f8-d3ee3bab51cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:30.126428 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8e53b677-0633-4034-a7f8-d3ee3bab51cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:30.126875 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8e53b677-0633-4034-a7f8-d3ee3bab51cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:30.127709 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8e53b677-0633-4034-a7f8-d3ee3bab51cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:30.128142 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8e53b677-0633-4034-a7f8-d3ee3bab51cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:30.273837 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8e53b677-0633-4034-a7f8-d3ee3bab51cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 17602 microversion: 2.20 time: 0.159448 Nov 23 04:15:30.274644 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 95/185] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:30 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 17602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:30.937418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-44e256ce-8d6d-41f9-82ca-6c7ab863d89d tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:30.938038 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-44e256ce-8d6d-41f9-82ca-6c7ab863d89d tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:30.944241 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44e256ce-8d6d-41f9-82ca-6c7ab863d89d tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:30.944695 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44e256ce-8d6d-41f9-82ca-6c7ab863d89d tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:30.945473 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44e256ce-8d6d-41f9-82ca-6c7ab863d89d tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:30.945916 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44e256ce-8d6d-41f9-82ca-6c7ab863d89d tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:30.959357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-44e256ce-8d6d-41f9-82ca-6c7ab863d89d tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] HTTP exception thrown: Instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 could not be found. Nov 23 04:15:30.959957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-44e256ce-8d6d-41f9-82ca-6c7ab863d89d tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Returning 404 to user: Instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:15:30.960829 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-44e256ce-8d6d-41f9-82ca-6c7ab863d89d tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 404 len: 111 microversion: 2.1 time: 0.028283 Nov 23 04:15:30.961388 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 91/186] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:30 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:15:31.086558 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-88088565-10c3-439d-8491-c3276fd5220e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:31.089120 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-88088565-10c3-439d-8491-c3276fd5220e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:31.096795 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-88088565-10c3-439d-8491-c3276fd5220e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:31.097288 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-88088565-10c3-439d-8491-c3276fd5220e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:31.098075 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-88088565-10c3-439d-8491-c3276fd5220e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:31.098779 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-88088565-10c3-439d-8491-c3276fd5220e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:31.115137 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-88088565-10c3-439d-8491-c3276fd5220e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] HTTP exception thrown: Instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 could not be found. Nov 23 04:15:31.115771 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-88088565-10c3-439d-8491-c3276fd5220e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Returning 404 to user: Instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:15:31.116745 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c309ca87-6a83-4660-a28e-470523911a1f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:31.116857 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-88088565-10c3-439d-8491-c3276fd5220e tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036489 Nov 23 04:15:31.116934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c309ca87-6a83-4660-a28e-470523911a1f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:31.117220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 96/187] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:15:31 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:15:31.123048 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c309ca87-6a83-4660-a28e-470523911a1f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:31.123559 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c309ca87-6a83-4660-a28e-470523911a1f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:31.124341 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c309ca87-6a83-4660-a28e-470523911a1f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:31.124771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c309ca87-6a83-4660-a28e-470523911a1f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:31.270499 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c309ca87-6a83-4660-a28e-470523911a1f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:31.278105 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c309ca87-6a83-4660-a28e-470523911a1f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.165926 Nov 23 04:15:31.278752 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 92/188] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:31 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:31.285564 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-20c12a14-4304-4feb-b963-60558c644bc9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:31.286599 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-20c12a14-4304-4feb-b963-60558c644bc9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:31.297406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20c12a14-4304-4feb-b963-60558c644bc9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:31.297406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20c12a14-4304-4feb-b963-60558c644bc9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:31.297406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20c12a14-4304-4feb-b963-60558c644bc9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:31.297406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20c12a14-4304-4feb-b963-60558c644bc9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:31.413665 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-20c12a14-4304-4feb-b963-60558c644bc9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 17659 microversion: 2.20 time: 0.131090 Nov 23 04:15:31.418235 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 97/189] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:31 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 17659 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:32.285765 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1176690606", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "networks": [{"uuid": "3f225ae5-6bd1-4fef-a8a2-1e95224823f9"}]}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:32.296677 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e8fb909d-c326-4fab-a9ac-e33c0eed6a56 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:32.297475 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e8fb909d-c326-4fab-a9ac-e33c0eed6a56 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:32.309598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8fb909d-c326-4fab-a9ac-e33c0eed6a56 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:32.310137 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8fb909d-c326-4fab-a9ac-e33c0eed6a56 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:32.310999 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8fb909d-c326-4fab-a9ac-e33c0eed6a56 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:32.311600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8fb909d-c326-4fab-a9ac-e33c0eed6a56 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:32.371644 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.network.neutron [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] validate_networks() for [('3f225ae5-6bd1-4fef-a8a2-1e95224823f9', None, None, None, None, None)] {{(pid=116837) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:15:32.577408 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e8fb909d-c326-4fab-a9ac-e33c0eed6a56 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:32.584902 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e8fb909d-c326-4fab-a9ac-e33c0eed6a56 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.292172 Nov 23 04:15:32.585549 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 98/190] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:32 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:32.590433 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9b0e725c-d3f1-40b1-8d35-aa8113733bda tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:32.591445 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9b0e725c-d3f1-40b1-8d35-aa8113733bda tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:32.597537 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9b0e725c-d3f1-40b1-8d35-aa8113733bda tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:32.598057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9b0e725c-d3f1-40b1-8d35-aa8113733bda tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:32.598908 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9b0e725c-d3f1-40b1-8d35-aa8113733bda tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:32.599448 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9b0e725c-d3f1-40b1-8d35-aa8113733bda tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:32.755327 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9b0e725c-d3f1-40b1-8d35-aa8113733bda tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 19342 microversion: 2.20 time: 0.168162 Nov 23 04:15:32.755972 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 99/191] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:32 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 19342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:32.761504 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-26b1c3e7-6d34-4606-8ee8-3ed1d60e0a44 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:32.762283 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-26b1c3e7-6d34-4606-8ee8-3ed1d60e0a44 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:32.769619 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-26b1c3e7-6d34-4606-8ee8-3ed1d60e0a44 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:32.770069 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-26b1c3e7-6d34-4606-8ee8-3ed1d60e0a44 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:32.770844 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-26b1c3e7-6d34-4606-8ee8-3ed1d60e0a44 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:32.771298 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-26b1c3e7-6d34-4606-8ee8-3ed1d60e0a44 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:32.785713 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-26b1c3e7-6d34-4606-8ee8-3ed1d60e0a44 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] HTTP exception thrown: Instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 could not be found. Nov 23 04:15:32.786304 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-26b1c3e7-6d34-4606-8ee8-3ed1d60e0a44 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Returning 404 to user: Instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:15:32.789039 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-26b1c3e7-6d34-4606-8ee8-3ed1d60e0a44 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "DELETE /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 404 len: 111 microversion: 2.1 time: 0.029920 Nov 23 04:15:32.789039 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 100/192] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:15:32 2021] DELETE /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:15:32.795847 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1a1fe480-265b-4f3b-881b-8bf5bf77c8c5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:32.796538 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1a1fe480-265b-4f3b-881b-8bf5bf77c8c5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] [instance: 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:32.803988 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a1fe480-265b-4f3b-881b-8bf5bf77c8c5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:32.804918 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a1fe480-265b-4f3b-881b-8bf5bf77c8c5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:32.806234 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a1fe480-265b-4f3b-881b-8bf5bf77c8c5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:32.807045 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a1fe480-265b-4f3b-881b-8bf5bf77c8c5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:32.824563 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-1a1fe480-265b-4f3b-881b-8bf5bf77c8c5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] HTTP exception thrown: Instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 could not be found. Nov 23 04:15:32.825152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1a1fe480-265b-4f3b-881b-8bf5bf77c8c5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] Returning 404 to user: Instance 3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:15:32.825969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1a1fe480-265b-4f3b-881b-8bf5bf77c8c5 tempest-DeleteServersTestJSON-1430664279 tempest-DeleteServersTestJSON-1430664279-project] 10.222.0.54 "GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5" status: 404 len: 111 microversion: 2.1 time: 0.033967 Nov 23 04:15:32.826740 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 101/193] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:32 2021] GET /compute/v2.1/servers/3e50b4e8-8b55-4abf-b356-7e130ff4c5a5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 04:15:32.847947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Flavor limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:15:32.848485 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Image limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:15:32.849189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Flavor pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:15:32.849754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Image pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:15:32.850559 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:15:32.861681 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:32.862216 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:32.863108 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:32.863581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:32.882301 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Getting quotas for project dc51e914f5e74ceca4086caa5a05b8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:15:32.887861 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Getting quotas for user 882a63823deb40dcb93ddc76f81ab9d0 and project dc51e914f5e74ceca4086caa5a05b8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:15:32.900128 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Going to run 1 instances... {{(pid=116837) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:15:32.903959 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:15:33.037550 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e9f050a2-7744-4689-bce7-dc8f4f95ace2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755712 Nov 23 04:15:33.039262 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 93/194] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:15:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:15:33.050363 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a7dca162-1fda-4ec6-9459-21f4f9f63eb5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:33.051021 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a7dca162-1fda-4ec6-9459-21f4f9f63eb5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:33.127047 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a7dca162-1fda-4ec6-9459-21f4f9f63eb5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:33.143587 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a7dca162-1fda-4ec6-9459-21f4f9f63eb5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1218 microversion: 2.1 time: 0.096874 Nov 23 04:15:33.168302 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 102/195] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:33 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:33.602536 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-48c4b548-117a-4c83-a813-2fbdd18bbe91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:33.603362 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-48c4b548-117a-4c83-a813-2fbdd18bbe91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:33.610075 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-48c4b548-117a-4c83-a813-2fbdd18bbe91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:33.610524 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-48c4b548-117a-4c83-a813-2fbdd18bbe91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:33.611337 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-48c4b548-117a-4c83-a813-2fbdd18bbe91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:33.611777 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-48c4b548-117a-4c83-a813-2fbdd18bbe91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:33.769574 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f24a817e-b80d-40c6-a048-6a096beb5e4f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:33.771400 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f24a817e-b80d-40c6-a048-6a096beb5e4f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:33.781610 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f24a817e-b80d-40c6-a048-6a096beb5e4f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:33.782307 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f24a817e-b80d-40c6-a048-6a096beb5e4f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:33.783142 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f24a817e-b80d-40c6-a048-6a096beb5e4f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:33.783774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f24a817e-b80d-40c6-a048-6a096beb5e4f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:33.788913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-48c4b548-117a-4c83-a813-2fbdd18bbe91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:33.798319 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-48c4b548-117a-4c83-a813-2fbdd18bbe91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.199895 Nov 23 04:15:33.799202 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 94/196] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:33 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:33.912702 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f24a817e-b80d-40c6-a048-6a096beb5e4f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 21269 microversion: 2.20 time: 0.149452 Nov 23 04:15:33.913259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 103/197] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:33 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 21269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:34.168381 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-cd74437d-5dce-4bfd-a243-4f8a69df6abe tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:34.168895 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-cd74437d-5dce-4bfd-a243-4f8a69df6abe tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:34.174586 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cd74437d-5dce-4bfd-a243-4f8a69df6abe tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:34.175051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cd74437d-5dce-4bfd-a243-4f8a69df6abe tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:34.175842 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cd74437d-5dce-4bfd-a243-4f8a69df6abe tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:34.176273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cd74437d-5dce-4bfd-a243-4f8a69df6abe tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:34.238543 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-cd74437d-5dce-4bfd-a243-4f8a69df6abe tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:34.242048 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-cd74437d-5dce-4bfd-a243-4f8a69df6abe tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1222 microversion: 2.1 time: 0.077756 Nov 23 04:15:34.242784 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 95/198] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:34 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:34.816299 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-061bb0ea-d9b7-40ed-b1e9-bcd275241f21 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:34.816985 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-061bb0ea-d9b7-40ed-b1e9-bcd275241f21 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:34.824358 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-061bb0ea-d9b7-40ed-b1e9-bcd275241f21 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:34.824884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-061bb0ea-d9b7-40ed-b1e9-bcd275241f21 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:34.825691 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-061bb0ea-d9b7-40ed-b1e9-bcd275241f21 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:34.826119 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-061bb0ea-d9b7-40ed-b1e9-bcd275241f21 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:34.931129 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9f3b351a-f7f6-41c3-b866-f108fca8fc87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:34.931129 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9f3b351a-f7f6-41c3-b866-f108fca8fc87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:34.936725 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f3b351a-f7f6-41c3-b866-f108fca8fc87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:34.937278 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f3b351a-f7f6-41c3-b866-f108fca8fc87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:34.940364 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f3b351a-f7f6-41c3-b866-f108fca8fc87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:34.940925 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f3b351a-f7f6-41c3-b866-f108fca8fc87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:34.996569 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-061bb0ea-d9b7-40ed-b1e9-bcd275241f21 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:35.005263 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-061bb0ea-d9b7-40ed-b1e9-bcd275241f21 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.192841 Nov 23 04:15:35.005843 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 104/199] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:34 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:35.069548 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9f3b351a-f7f6-41c3-b866-f108fca8fc87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 22702 microversion: 2.20 time: 0.148789 Nov 23 04:15:35.070186 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 96/200] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:34 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 22702 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:15:35.259622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b5431b35-db8d-437e-8892-1cc7a410db80 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:35.261107 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b5431b35-db8d-437e-8892-1cc7a410db80 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:35.268654 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b5431b35-db8d-437e-8892-1cc7a410db80 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:35.269281 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b5431b35-db8d-437e-8892-1cc7a410db80 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:35.270571 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b5431b35-db8d-437e-8892-1cc7a410db80 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:35.271404 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b5431b35-db8d-437e-8892-1cc7a410db80 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:35.332531 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b5431b35-db8d-437e-8892-1cc7a410db80 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:35.340393 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b5431b35-db8d-437e-8892-1cc7a410db80 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1270 microversion: 2.1 time: 0.084403 Nov 23 04:15:35.340994 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 105/201] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:35 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:36.023754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6de46704-7af3-49b6-915b-43c56a49ab91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:36.024451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6de46704-7af3-49b6-915b-43c56a49ab91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:36.035703 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6de46704-7af3-49b6-915b-43c56a49ab91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:36.036113 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6de46704-7af3-49b6-915b-43c56a49ab91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:36.036903 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6de46704-7af3-49b6-915b-43c56a49ab91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:36.037339 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6de46704-7af3-49b6-915b-43c56a49ab91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:36.082160 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dc07a224-3ffe-494b-9c74-8fffbea6842f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:36.083079 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dc07a224-3ffe-494b-9c74-8fffbea6842f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:36.090035 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc07a224-3ffe-494b-9c74-8fffbea6842f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:36.090598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc07a224-3ffe-494b-9c74-8fffbea6842f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:36.091586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc07a224-3ffe-494b-9c74-8fffbea6842f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:36.092111 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc07a224-3ffe-494b-9c74-8fffbea6842f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:36.212431 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dc07a224-3ffe-494b-9c74-8fffbea6842f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 23780 microversion: 2.20 time: 0.133508 Nov 23 04:15:36.217813 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 106/202] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:36 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 23780 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:15:36.272336 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6de46704-7af3-49b6-915b-43c56a49ab91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:36.283330 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6de46704-7af3-49b6-915b-43c56a49ab91 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.263697 Nov 23 04:15:36.284040 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 97/203] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:36 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:36.361577 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ca445fd6-b369-407b-bcb7-82ac558fecd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:36.362363 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ca445fd6-b369-407b-bcb7-82ac558fecd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:36.369270 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca445fd6-b369-407b-bcb7-82ac558fecd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:36.370570 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca445fd6-b369-407b-bcb7-82ac558fecd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:36.371617 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca445fd6-b369-407b-bcb7-82ac558fecd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:36.372121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca445fd6-b369-407b-bcb7-82ac558fecd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:36.456260 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ca445fd6-b369-407b-bcb7-82ac558fecd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:36.469508 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ca445fd6-b369-407b-bcb7-82ac558fecd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1276 microversion: 2.1 time: 0.113209 Nov 23 04:15:36.470457 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 107/204] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:36 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:37.230640 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d96a9d78-ca67-4b9d-b68f-21e7cc751fac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:37.232975 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d96a9d78-ca67-4b9d-b68f-21e7cc751fac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:37.241857 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d96a9d78-ca67-4b9d-b68f-21e7cc751fac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:37.242493 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d96a9d78-ca67-4b9d-b68f-21e7cc751fac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:37.243425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d96a9d78-ca67-4b9d-b68f-21e7cc751fac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:37.244521 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d96a9d78-ca67-4b9d-b68f-21e7cc751fac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:37.301049 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e6ba3b11-de8b-4dd7-bedc-180e6c958ee0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:37.302181 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e6ba3b11-de8b-4dd7-bedc-180e6c958ee0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:37.309453 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6ba3b11-de8b-4dd7-bedc-180e6c958ee0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:37.309910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6ba3b11-de8b-4dd7-bedc-180e6c958ee0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:37.310705 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6ba3b11-de8b-4dd7-bedc-180e6c958ee0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:37.311143 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6ba3b11-de8b-4dd7-bedc-180e6c958ee0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:37.358661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d96a9d78-ca67-4b9d-b68f-21e7cc751fac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 24748 microversion: 2.20 time: 0.138088 Nov 23 04:15:37.359326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 98/205] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:37 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 24748 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:37.487558 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6276a14c-c700-43b9-a1cf-8c4264bf83e5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:37.488400 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6276a14c-c700-43b9-a1cf-8c4264bf83e5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:37.495781 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6276a14c-c700-43b9-a1cf-8c4264bf83e5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:37.497171 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6276a14c-c700-43b9-a1cf-8c4264bf83e5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:37.497323 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6276a14c-c700-43b9-a1cf-8c4264bf83e5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:37.497836 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6276a14c-c700-43b9-a1cf-8c4264bf83e5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:37.619526 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e6ba3b11-de8b-4dd7-bedc-180e6c958ee0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:37.640961 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e6ba3b11-de8b-4dd7-bedc-180e6c958ee0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.343554 Nov 23 04:15:37.641801 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 108/206] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:37 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:37.730707 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6276a14c-c700-43b9-a1cf-8c4264bf83e5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:37.738088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6276a14c-c700-43b9-a1cf-8c4264bf83e5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1318 microversion: 2.1 time: 0.254439 Nov 23 04:15:37.741966 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 99/207] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:37 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:37.978706 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-d6bc8583-7b3a-4d69-95f9-9e89910b441f req-ff38cbd4-aeec-4aa3-8deb-1de242bc93b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b618a52-9e4c-43d1-8b3d-97412bd51aed", "tag": "070ef4fa-f032-4309-bfe7-5f82f3d8a95a"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:37.987288 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:15:37.987288 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:15:37.996546 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-d6bc8583-7b3a-4d69-95f9-9e89910b441f req-ff38cbd4-aeec-4aa3-8deb-1de242bc93b7 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:37.997267 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-d6bc8583-7b3a-4d69-95f9-9e89910b441f req-ff38cbd4-aeec-4aa3-8deb-1de242bc93b7 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:38.014128 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-d6bc8583-7b3a-4d69-95f9-9e89910b441f req-ff38cbd4-aeec-4aa3-8deb-1de242bc93b7 service nova] Creating event network-changed:070ef4fa-f032-4309-bfe7-5f82f3d8a95a for instance 1b618a52-9e4c-43d1-8b3d-97412bd51aed on hv-cinder-76845 Nov 23 04:15:38.020738 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-d6bc8583-7b3a-4d69-95f9-9e89910b441f req-ff38cbd4-aeec-4aa3-8deb-1de242bc93b7 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045642 Nov 23 04:15:38.021822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 109/208] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:15:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:15:38.411517 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d44b8b2a-53e5-4a3b-8c5b-9e12b7825a30 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:38.412682 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d44b8b2a-53e5-4a3b-8c5b-9e12b7825a30 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:38.420508 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d44b8b2a-53e5-4a3b-8c5b-9e12b7825a30 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:38.421079 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d44b8b2a-53e5-4a3b-8c5b-9e12b7825a30 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:38.421895 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d44b8b2a-53e5-4a3b-8c5b-9e12b7825a30 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:38.422326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d44b8b2a-53e5-4a3b-8c5b-9e12b7825a30 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:38.544729 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d44b8b2a-53e5-4a3b-8c5b-9e12b7825a30 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 25885 microversion: 2.20 time: 0.136638 Nov 23 04:15:38.546265 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 100/209] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:38 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 25885 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:15:38.659575 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-82279a84-c9ff-496e-a70b-2add6a26cc8f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:38.660266 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-82279a84-c9ff-496e-a70b-2add6a26cc8f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:38.669084 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-82279a84-c9ff-496e-a70b-2add6a26cc8f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:38.669965 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-82279a84-c9ff-496e-a70b-2add6a26cc8f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:38.671619 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-82279a84-c9ff-496e-a70b-2add6a26cc8f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:38.673567 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-82279a84-c9ff-496e-a70b-2add6a26cc8f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:38.760830 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4bbdf0dd-8b85-4c6d-abe8-5295a7ebdada tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:38.762089 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4bbdf0dd-8b85-4c6d-abe8-5295a7ebdada tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:38.773313 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bbdf0dd-8b85-4c6d-abe8-5295a7ebdada tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:38.774124 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bbdf0dd-8b85-4c6d-abe8-5295a7ebdada tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:38.775534 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bbdf0dd-8b85-4c6d-abe8-5295a7ebdada tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:38.776938 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bbdf0dd-8b85-4c6d-abe8-5295a7ebdada tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:38.991099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-82279a84-c9ff-496e-a70b-2add6a26cc8f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:39.006987 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-82279a84-c9ff-496e-a70b-2add6a26cc8f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.352046 Nov 23 04:15:39.009220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 110/210] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:38 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:39.102307 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4bbdf0dd-8b85-4c6d-abe8-5295a7ebdada tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:39.118359 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4bbdf0dd-8b85-4c6d-abe8-5295a7ebdada tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1318 microversion: 2.1 time: 0.365180 Nov 23 04:15:39.121193 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 101/211] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:38 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:39.556367 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ae6116c1-360e-4de6-82cc-2d189e29cbfa tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:39.558095 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ae6116c1-360e-4de6-82cc-2d189e29cbfa tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:39.564055 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae6116c1-360e-4de6-82cc-2d189e29cbfa tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:39.564564 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae6116c1-360e-4de6-82cc-2d189e29cbfa tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:39.565379 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae6116c1-360e-4de6-82cc-2d189e29cbfa tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:39.565815 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae6116c1-360e-4de6-82cc-2d189e29cbfa tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:39.681992 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ae6116c1-360e-4de6-82cc-2d189e29cbfa tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 26592 microversion: 2.20 time: 0.128999 Nov 23 04:15:39.683427 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 111/212] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:39 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 26592 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:40.025508 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0577e7b8-ec93-4b3f-803a-ef8ecf9c2f01 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:40.026997 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0577e7b8-ec93-4b3f-803a-ef8ecf9c2f01 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:40.033771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0577e7b8-ec93-4b3f-803a-ef8ecf9c2f01 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:40.033771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0577e7b8-ec93-4b3f-803a-ef8ecf9c2f01 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:40.034982 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0577e7b8-ec93-4b3f-803a-ef8ecf9c2f01 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:40.035445 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0577e7b8-ec93-4b3f-803a-ef8ecf9c2f01 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:40.136845 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-68ee468b-1182-43a2-a09a-2b3164998824 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:40.137532 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-68ee468b-1182-43a2-a09a-2b3164998824 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:40.144463 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-68ee468b-1182-43a2-a09a-2b3164998824 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:40.144885 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-68ee468b-1182-43a2-a09a-2b3164998824 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:40.145665 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-68ee468b-1182-43a2-a09a-2b3164998824 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:40.146096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-68ee468b-1182-43a2-a09a-2b3164998824 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:40.190441 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0577e7b8-ec93-4b3f-803a-ef8ecf9c2f01 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:40.199144 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0577e7b8-ec93-4b3f-803a-ef8ecf9c2f01 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.177065 Nov 23 04:15:40.200853 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 102/213] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:40 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:40.310287 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-68ee468b-1182-43a2-a09a-2b3164998824 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:40.317622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-68ee468b-1182-43a2-a09a-2b3164998824 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1318 microversion: 2.1 time: 0.184859 Nov 23 04:15:40.328167 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 112/214] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:40 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:40.693788 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-dec3ed8d-0bf3-4502-b512-f39bcb3434fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:40.694764 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-dec3ed8d-0bf3-4502-b512-f39bcb3434fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:40.701934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dec3ed8d-0bf3-4502-b512-f39bcb3434fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:40.702385 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dec3ed8d-0bf3-4502-b512-f39bcb3434fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:40.703253 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dec3ed8d-0bf3-4502-b512-f39bcb3434fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:40.703703 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dec3ed8d-0bf3-4502-b512-f39bcb3434fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:40.812357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-dec3ed8d-0bf3-4502-b512-f39bcb3434fe tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 27155 microversion: 2.20 time: 0.121979 Nov 23 04:15:40.812940 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 103/215] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:40 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 27155 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:41.226700 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6e1a8762-93db-4d71-b7bc-851fe1968528 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:41.227359 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6e1a8762-93db-4d71-b7bc-851fe1968528 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:41.234743 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e1a8762-93db-4d71-b7bc-851fe1968528 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:41.235187 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e1a8762-93db-4d71-b7bc-851fe1968528 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:41.236004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e1a8762-93db-4d71-b7bc-851fe1968528 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:41.236430 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e1a8762-93db-4d71-b7bc-851fe1968528 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:41.336430 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a823ac75-2f1a-4031-b8a4-c6bbd10e2cf2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:41.336430 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a823ac75-2f1a-4031-b8a4-c6bbd10e2cf2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:41.345838 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a823ac75-2f1a-4031-b8a4-c6bbd10e2cf2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:41.346285 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a823ac75-2f1a-4031-b8a4-c6bbd10e2cf2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:41.347076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a823ac75-2f1a-4031-b8a4-c6bbd10e2cf2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:41.347531 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a823ac75-2f1a-4031-b8a4-c6bbd10e2cf2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:41.383381 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6e1a8762-93db-4d71-b7bc-851fe1968528 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:41.391171 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6e1a8762-93db-4d71-b7bc-851fe1968528 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.168056 Nov 23 04:15:41.391901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 113/216] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:41 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:41.492000 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a823ac75-2f1a-4031-b8a4-c6bbd10e2cf2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:41.499421 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a823ac75-2f1a-4031-b8a4-c6bbd10e2cf2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1318 microversion: 2.1 time: 0.167647 Nov 23 04:15:41.499989 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 104/217] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:41 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:41.824532 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-751a8cf6-2561-40b6-8fbc-81161a31b5b9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:41.825579 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-751a8cf6-2561-40b6-8fbc-81161a31b5b9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:41.831869 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-751a8cf6-2561-40b6-8fbc-81161a31b5b9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:41.832343 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-751a8cf6-2561-40b6-8fbc-81161a31b5b9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:41.833132 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-751a8cf6-2561-40b6-8fbc-81161a31b5b9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:41.833562 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-751a8cf6-2561-40b6-8fbc-81161a31b5b9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:41.937426 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-751a8cf6-2561-40b6-8fbc-81161a31b5b9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 27566 microversion: 2.20 time: 0.117062 Nov 23 04:15:41.937986 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 114/218] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:41 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 27566 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:15:42.409269 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-18e334f7-72ee-4509-bd10-1476a3462c49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:42.410693 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-18e334f7-72ee-4509-bd10-1476a3462c49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:42.420011 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-18e334f7-72ee-4509-bd10-1476a3462c49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:42.420011 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-18e334f7-72ee-4509-bd10-1476a3462c49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:42.420679 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-18e334f7-72ee-4509-bd10-1476a3462c49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:42.421056 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-18e334f7-72ee-4509-bd10-1476a3462c49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:42.516614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3dbc4e0c-6d53-4406-aebc-6ec648018fa2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:42.518480 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3dbc4e0c-6d53-4406-aebc-6ec648018fa2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:42.525488 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3dbc4e0c-6d53-4406-aebc-6ec648018fa2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:42.526145 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3dbc4e0c-6d53-4406-aebc-6ec648018fa2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:42.526946 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3dbc4e0c-6d53-4406-aebc-6ec648018fa2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:42.527417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3dbc4e0c-6d53-4406-aebc-6ec648018fa2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:42.588826 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-18e334f7-72ee-4509-bd10-1476a3462c49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:42.598418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-18e334f7-72ee-4509-bd10-1476a3462c49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.192592 Nov 23 04:15:42.609511 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 105/219] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:42 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:42.732619 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3dbc4e0c-6d53-4406-aebc-6ec648018fa2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:42.739812 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3dbc4e0c-6d53-4406-aebc-6ec648018fa2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1318 microversion: 2.1 time: 0.227260 Nov 23 04:15:42.740383 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 115/220] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:42 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:42.948534 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d3c1bfc4-a2b9-4599-ad4f-00e0f035b49b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:42.949634 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d3c1bfc4-a2b9-4599-ad4f-00e0f035b49b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:42.955861 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d3c1bfc4-a2b9-4599-ad4f-00e0f035b49b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:42.956199 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d3c1bfc4-a2b9-4599-ad4f-00e0f035b49b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:42.957160 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d3c1bfc4-a2b9-4599-ad4f-00e0f035b49b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:42.957773 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d3c1bfc4-a2b9-4599-ad4f-00e0f035b49b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:43.070382 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d3c1bfc4-a2b9-4599-ad4f-00e0f035b49b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 27838 microversion: 2.20 time: 0.125511 Nov 23 04:15:43.071131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 106/221] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:42 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 27838 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:43.616391 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-eaf285ed-67e5-4e37-95df-bc9f2be2a475 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:43.617198 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-eaf285ed-67e5-4e37-95df-bc9f2be2a475 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:43.626944 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eaf285ed-67e5-4e37-95df-bc9f2be2a475 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:43.627782 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eaf285ed-67e5-4e37-95df-bc9f2be2a475 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:43.628775 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eaf285ed-67e5-4e37-95df-bc9f2be2a475 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:43.629476 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eaf285ed-67e5-4e37-95df-bc9f2be2a475 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:43.762536 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-37a6a857-f6fb-4a56-8995-3866e2bbde0d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:43.763260 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-37a6a857-f6fb-4a56-8995-3866e2bbde0d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:43.770498 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-37a6a857-f6fb-4a56-8995-3866e2bbde0d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:43.770945 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-37a6a857-f6fb-4a56-8995-3866e2bbde0d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:43.771773 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-37a6a857-f6fb-4a56-8995-3866e2bbde0d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:43.772207 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-37a6a857-f6fb-4a56-8995-3866e2bbde0d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:43.829291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-eaf285ed-67e5-4e37-95df-bc9f2be2a475 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:43.842700 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-eaf285ed-67e5-4e37-95df-bc9f2be2a475 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.230493 Nov 23 04:15:43.844038 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 116/222] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:43 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:44.032513 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-37a6a857-f6fb-4a56-8995-3866e2bbde0d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:44.042028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-37a6a857-f6fb-4a56-8995-3866e2bbde0d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1318 microversion: 2.1 time: 0.283867 Nov 23 04:15:44.042604 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 107/223] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:43 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:44.085225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fe2cfa89-b163-4bf6-991a-a0f30ba91dd2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:44.086136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fe2cfa89-b163-4bf6-991a-a0f30ba91dd2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:44.093347 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fe2cfa89-b163-4bf6-991a-a0f30ba91dd2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:44.094112 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fe2cfa89-b163-4bf6-991a-a0f30ba91dd2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:44.096129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fe2cfa89-b163-4bf6-991a-a0f30ba91dd2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:44.096129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fe2cfa89-b163-4bf6-991a-a0f30ba91dd2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:44.203747 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fe2cfa89-b163-4bf6-991a-a0f30ba91dd2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28109 microversion: 2.20 time: 0.122103 Nov 23 04:15:44.204684 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 117/224] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:44 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28109 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:15:44.782709 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-ea3a9542-0721-441d-8a84-147e16eb3f66 req-5fe5da08-9e5c-4941-93e9-50fac7634a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b618a52-9e4c-43d1-8b3d-97412bd51aed", "name": "network-vif-plugged", "status": "completed", "tag": "070ef4fa-f032-4309-bfe7-5f82f3d8a95a"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:44.784493 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:15:44.784493 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:15:44.795478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-ea3a9542-0721-441d-8a84-147e16eb3f66 req-5fe5da08-9e5c-4941-93e9-50fac7634a0a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:44.795924 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-ea3a9542-0721-441d-8a84-147e16eb3f66 req-5fe5da08-9e5c-4941-93e9-50fac7634a0a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:44.806361 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-ea3a9542-0721-441d-8a84-147e16eb3f66 req-5fe5da08-9e5c-4941-93e9-50fac7634a0a service nova] Creating event network-vif-plugged:070ef4fa-f032-4309-bfe7-5f82f3d8a95a for instance 1b618a52-9e4c-43d1-8b3d-97412bd51aed on hv-cinder-76845 Nov 23 04:15:44.811344 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-ea3a9542-0721-441d-8a84-147e16eb3f66 req-5fe5da08-9e5c-4941-93e9-50fac7634a0a service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033503 Nov 23 04:15:44.812181 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 108/225] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:15:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:15:44.861299 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-97a3a7af-2737-4720-91c7-60d8df3da78d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:44.861996 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-97a3a7af-2737-4720-91c7-60d8df3da78d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:44.876892 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-97a3a7af-2737-4720-91c7-60d8df3da78d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:44.877949 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-97a3a7af-2737-4720-91c7-60d8df3da78d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:44.879023 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-97a3a7af-2737-4720-91c7-60d8df3da78d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:44.879653 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-97a3a7af-2737-4720-91c7-60d8df3da78d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:45.032482 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-97a3a7af-2737-4720-91c7-60d8df3da78d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:45.054029 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-97a3a7af-2737-4720-91c7-60d8df3da78d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.190444 Nov 23 04:15:45.054029 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 118/226] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:44 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:45.061158 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bca00902-afb9-42bd-b6bd-b7ec0a8be41b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:45.062053 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-bca00902-afb9-42bd-b6bd-b7ec0a8be41b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:45.068416 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bca00902-afb9-42bd-b6bd-b7ec0a8be41b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:45.068885 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bca00902-afb9-42bd-b6bd-b7ec0a8be41b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:45.069734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bca00902-afb9-42bd-b6bd-b7ec0a8be41b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:45.070211 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bca00902-afb9-42bd-b6bd-b7ec0a8be41b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:45.217093 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6606262e-c295-4b1b-b313-c55386f6b910 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:45.218031 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6606262e-c295-4b1b-b313-c55386f6b910 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:45.225040 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6606262e-c295-4b1b-b313-c55386f6b910 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:45.225495 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6606262e-c295-4b1b-b313-c55386f6b910 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:45.226279 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6606262e-c295-4b1b-b313-c55386f6b910 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:45.226706 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6606262e-c295-4b1b-b313-c55386f6b910 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:45.317687 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bca00902-afb9-42bd-b6bd-b7ec0a8be41b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:45.329898 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bca00902-afb9-42bd-b6bd-b7ec0a8be41b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1318 microversion: 2.1 time: 0.273611 Nov 23 04:15:45.330476 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 109/227] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:45 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:45.355268 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6606262e-c295-4b1b-b313-c55386f6b910 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28168 microversion: 2.20 time: 0.142703 Nov 23 04:15:45.356054 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 119/228] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:45 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28168 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:15:46.073567 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ce37d21f-032f-4b40-bf50-a8518bedb5de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:46.073567 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ce37d21f-032f-4b40-bf50-a8518bedb5de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:46.075616 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ce37d21f-032f-4b40-bf50-a8518bedb5de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:46.076502 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ce37d21f-032f-4b40-bf50-a8518bedb5de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:46.077443 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ce37d21f-032f-4b40-bf50-a8518bedb5de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:46.078052 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ce37d21f-032f-4b40-bf50-a8518bedb5de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:46.282475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ce37d21f-032f-4b40-bf50-a8518bedb5de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:46.290669 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ce37d21f-032f-4b40-bf50-a8518bedb5de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.225236 Nov 23 04:15:46.291549 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 110/229] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:46 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:46.349186 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7675ec27-0071-49c6-aff7-d65215821753 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:46.350542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7675ec27-0071-49c6-aff7-d65215821753 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:46.358511 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7675ec27-0071-49c6-aff7-d65215821753 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:46.359274 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7675ec27-0071-49c6-aff7-d65215821753 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:46.360292 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7675ec27-0071-49c6-aff7-d65215821753 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:46.360834 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7675ec27-0071-49c6-aff7-d65215821753 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:46.372115 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-60086426-8a46-4f22-893c-494b196304f3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:46.373142 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-60086426-8a46-4f22-893c-494b196304f3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:46.379232 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60086426-8a46-4f22-893c-494b196304f3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:46.391064 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60086426-8a46-4f22-893c-494b196304f3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:46.392085 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60086426-8a46-4f22-893c-494b196304f3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:46.392550 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60086426-8a46-4f22-893c-494b196304f3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:46.511705 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-60086426-8a46-4f22-893c-494b196304f3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28168 microversion: 2.20 time: 0.143612 Nov 23 04:15:46.513122 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 111/230] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:46 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28168 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:15:46.533057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-7675ec27-0071-49c6-aff7-d65215821753 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:46.540666 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7675ec27-0071-49c6-aff7-d65215821753 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1318 microversion: 2.1 time: 0.196504 Nov 23 04:15:46.541239 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 120/231] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:46 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:47.308918 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2b93a2b8-6064-43c5-9d31-da3d98294b97 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:47.310344 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2b93a2b8-6064-43c5-9d31-da3d98294b97 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:47.318015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2b93a2b8-6064-43c5-9d31-da3d98294b97 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:47.318684 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2b93a2b8-6064-43c5-9d31-da3d98294b97 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:47.319906 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2b93a2b8-6064-43c5-9d31-da3d98294b97 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:47.320570 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2b93a2b8-6064-43c5-9d31-da3d98294b97 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:47.470353 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2b93a2b8-6064-43c5-9d31-da3d98294b97 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:47.479919 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2b93a2b8-6064-43c5-9d31-da3d98294b97 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.174324 Nov 23 04:15:47.480791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 112/232] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:47 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:47.523759 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-27f62e02-7ea5-491f-95ce-f5229f127dcd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:47.525301 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-27f62e02-7ea5-491f-95ce-f5229f127dcd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:47.536906 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27f62e02-7ea5-491f-95ce-f5229f127dcd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:47.537587 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27f62e02-7ea5-491f-95ce-f5229f127dcd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:47.538849 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27f62e02-7ea5-491f-95ce-f5229f127dcd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:47.539500 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27f62e02-7ea5-491f-95ce-f5229f127dcd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:47.560202 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ea81a8fb-0387-4d49-a861-fe26c7d934f5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:47.560894 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ea81a8fb-0387-4d49-a861-fe26c7d934f5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:47.567703 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ea81a8fb-0387-4d49-a861-fe26c7d934f5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:47.570775 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ea81a8fb-0387-4d49-a861-fe26c7d934f5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:47.570775 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ea81a8fb-0387-4d49-a861-fe26c7d934f5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:47.570775 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ea81a8fb-0387-4d49-a861-fe26c7d934f5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:47.685575 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-27f62e02-7ea5-491f-95ce-f5229f127dcd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28459 microversion: 2.20 time: 0.165219 Nov 23 04:15:47.686232 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 121/233] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:47 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28459 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:47.717888 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ea81a8fb-0387-4d49-a861-fe26c7d934f5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:47.725327 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ea81a8fb-0387-4d49-a861-fe26c7d934f5 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1507 microversion: 2.1 time: 0.170538 Nov 23 04:15:47.725894 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 113/234] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:47 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:47.747566 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-42f701e5-b5e5-4fdf-844a-976de3e56ff0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51863c1b-92bb-428a-b625-5f063e1c3714"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:47.749176 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-42f701e5-b5e5-4fdf-844a-976de3e56ff0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:47.756718 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42f701e5-b5e5-4fdf-844a-976de3e56ff0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:47.757161 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42f701e5-b5e5-4fdf-844a-976de3e56ff0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:47.757940 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42f701e5-b5e5-4fdf-844a-976de3e56ff0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:47.758534 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42f701e5-b5e5-4fdf-844a-976de3e56ff0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:47.875042 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-42f701e5-b5e5-4fdf-844a-976de3e56ff0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] HTTP exception thrown: Invalid volume: volume 51863c1b-92bb-428a-b625-5f063e1c3714 is already attached to instances: 87273409-979f-4dd3-b901-60f00ba87d4c Nov 23 04:15:47.875669 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-42f701e5-b5e5-4fdf-844a-976de3e56ff0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Returning 400 to user: Invalid volume: volume 51863c1b-92bb-428a-b625-5f063e1c3714 is already attached to instances: 87273409-979f-4dd3-b901-60f00ba87d4c {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:15:47.876492 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-42f701e5-b5e5-4fdf-844a-976de3e56ff0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "POST /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134383 Nov 23 04:15:47.877047 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 122/235] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:15:47 2021] POST /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 04:15:48.221917 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-44d74b65-d7a8-40b1-bbd9-eac83cd44a03 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:48.222419 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-44d74b65-d7a8-40b1-bbd9-eac83cd44a03 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:48.228833 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44d74b65-d7a8-40b1-bbd9-eac83cd44a03 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:48.229966 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44d74b65-d7a8-40b1-bbd9-eac83cd44a03 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:48.230828 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44d74b65-d7a8-40b1-bbd9-eac83cd44a03 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:48.231388 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-44d74b65-d7a8-40b1-bbd9-eac83cd44a03 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:48.363590 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-44d74b65-d7a8-40b1-bbd9-eac83cd44a03 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lazy-loading 'services' on Instance uuid 87273409-979f-4dd3-b901-60f00ba87d4c {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:15:48.500262 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f433a098-4f5b-4a9b-9530-83249f0f95b3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:48.500892 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f433a098-4f5b-4a9b-9530-83249f0f95b3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:48.507610 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f433a098-4f5b-4a9b-9530-83249f0f95b3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:48.508065 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f433a098-4f5b-4a9b-9530-83249f0f95b3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:48.508934 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f433a098-4f5b-4a9b-9530-83249f0f95b3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:48.509375 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f433a098-4f5b-4a9b-9530-83249f0f95b3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:48.643596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f433a098-4f5b-4a9b-9530-83249f0f95b3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:48.653571 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f433a098-4f5b-4a9b-9530-83249f0f95b3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.157998 Nov 23 04:15:48.654139 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 123/236] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:48 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:48.697452 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b8b327b2-993b-4db9-99b3-6d32ea0ab5c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:48.699036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b8b327b2-993b-4db9-99b3-6d32ea0ab5c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:48.704920 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b8b327b2-993b-4db9-99b3-6d32ea0ab5c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:48.705369 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b8b327b2-993b-4db9-99b3-6d32ea0ab5c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:48.706146 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b8b327b2-993b-4db9-99b3-6d32ea0ab5c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:48.706579 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b8b327b2-993b-4db9-99b3-6d32ea0ab5c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:48.797922 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-44d74b65-d7a8-40b1-bbd9-eac83cd44a03 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "DELETE /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c/os-volume_attachments/51863c1b-92bb-428a-b625-5f063e1c3714" status: 202 len: 0 microversion: 2.1 time: 0.579896 Nov 23 04:15:48.798645 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 114/237] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:15:48 2021] DELETE /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c/os-volume_attachments/51863c1b-92bb-428a-b625-5f063e1c3714 => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:48.808358 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-880f80c8-ac76-4d54-a3fd-9ef7df0f7a3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:48.810406 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-880f80c8-ac76-4d54-a3fd-9ef7df0f7a3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:48.818186 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-880f80c8-ac76-4d54-a3fd-9ef7df0f7a3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:48.818674 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-880f80c8-ac76-4d54-a3fd-9ef7df0f7a3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:48.819517 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-880f80c8-ac76-4d54-a3fd-9ef7df0f7a3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:48.820129 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-880f80c8-ac76-4d54-a3fd-9ef7df0f7a3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:48.825164 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b8b327b2-993b-4db9-99b3-6d32ea0ab5c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28459 microversion: 2.20 time: 0.131221 Nov 23 04:15:48.826001 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 124/238] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:48 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28459 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:15:48.862099 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-880f80c8-ac76-4d54-a3fd-9ef7df0f7a3d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058589 Nov 23 04:15:48.863936 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 115/239] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:15:48 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:15:49.671548 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8a2561e6-3c4b-4865-b484-b828a6677ca8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:49.672807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8a2561e6-3c4b-4865-b484-b828a6677ca8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:49.680535 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a2561e6-3c4b-4865-b484-b828a6677ca8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:49.681244 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a2561e6-3c4b-4865-b484-b828a6677ca8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:49.682573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a2561e6-3c4b-4865-b484-b828a6677ca8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:49.683384 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a2561e6-3c4b-4865-b484-b828a6677ca8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:49.834484 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8a2561e6-3c4b-4865-b484-b828a6677ca8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:49.837213 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0e0d72e6-17d9-43db-9e3b-abf65616b963 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:49.838410 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0e0d72e6-17d9-43db-9e3b-abf65616b963 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:49.842475 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8a2561e6-3c4b-4865-b484-b828a6677ca8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.175102 Nov 23 04:15:49.843286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 125/240] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:49 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:49.845293 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e0d72e6-17d9-43db-9e3b-abf65616b963 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:49.845741 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e0d72e6-17d9-43db-9e3b-abf65616b963 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:49.846797 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e0d72e6-17d9-43db-9e3b-abf65616b963 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:49.847267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e0d72e6-17d9-43db-9e3b-abf65616b963 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:49.874745 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4bc3ed53-6983-4b37-9e19-90b173fc67c8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:49.876285 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4bc3ed53-6983-4b37-9e19-90b173fc67c8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:49.882616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4bc3ed53-6983-4b37-9e19-90b173fc67c8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:49.883344 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4bc3ed53-6983-4b37-9e19-90b173fc67c8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:49.884135 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4bc3ed53-6983-4b37-9e19-90b173fc67c8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:49.884570 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4bc3ed53-6983-4b37-9e19-90b173fc67c8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:49.930802 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4bc3ed53-6983-4b37-9e19-90b173fc67c8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059694 Nov 23 04:15:49.931587 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 126/241] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:15:49 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:15:49.997691 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0e0d72e6-17d9-43db-9e3b-abf65616b963 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28627 microversion: 2.20 time: 0.163892 Nov 23 04:15:49.998345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 116/242] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:49 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28627 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:50.859800 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-04df2dc0-bc57-4352-ad7f-c1f5d564bfb2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:50.860580 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-04df2dc0-bc57-4352-ad7f-c1f5d564bfb2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:50.866776 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04df2dc0-bc57-4352-ad7f-c1f5d564bfb2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:50.867415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04df2dc0-bc57-4352-ad7f-c1f5d564bfb2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:50.868205 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04df2dc0-bc57-4352-ad7f-c1f5d564bfb2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:50.868636 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04df2dc0-bc57-4352-ad7f-c1f5d564bfb2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:50.943516 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fe14b0f9-f3a7-4045-8099-e602507a4f5d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:50.944582 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fe14b0f9-f3a7-4045-8099-e602507a4f5d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:50.953662 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fe14b0f9-f3a7-4045-8099-e602507a4f5d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:50.954228 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fe14b0f9-f3a7-4045-8099-e602507a4f5d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:50.955278 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fe14b0f9-f3a7-4045-8099-e602507a4f5d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:50.955811 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fe14b0f9-f3a7-4045-8099-e602507a4f5d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:50.988582 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fe14b0f9-f3a7-4045-8099-e602507a4f5d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049337 Nov 23 04:15:50.989415 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 117/243] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:15:50 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 04:15:51.009463 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5de7385f-81a0-4585-9461-38bfdcd514e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:51.010718 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5de7385f-81a0-4585-9461-38bfdcd514e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:51.017420 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5de7385f-81a0-4585-9461-38bfdcd514e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:51.019074 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5de7385f-81a0-4585-9461-38bfdcd514e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:51.019276 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5de7385f-81a0-4585-9461-38bfdcd514e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:51.019735 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5de7385f-81a0-4585-9461-38bfdcd514e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:51.021239 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-04df2dc0-bc57-4352-ad7f-c1f5d564bfb2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:51.045379 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-04df2dc0-bc57-4352-ad7f-c1f5d564bfb2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.175883 Nov 23 04:15:51.045379 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 127/244] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:50 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:51.180612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1282776810", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:51.231870 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] validate_networks() for None {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:15:51.528294 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:15:51.528709 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:15:51.529232 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:15:51.529646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:15:51.530045 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:15:51.538532 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:51.538968 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:51.540096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:51.540523 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:51.556011 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Getting quotas for project d5ed34581a5e4a4b8f22a96ca010c337. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:15:51.559890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Getting quotas for user b9afaf378d784aaa90752b936005a687 and project d5ed34581a5e4a4b8f22a96ca010c337. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:15:51.570085 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:15:51.572898 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:15:51.805059 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3ec28978-bd62-4304-8072-373033525f48 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632802 Nov 23 04:15:51.809833 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 128/245] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:15:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 04:15:51.813042 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-350360121", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "networks": [{"uuid": "3f225ae5-6bd1-4fef-a8a2-1e95224823f9"}]}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:51.870442 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] validate_networks() for [('3f225ae5-6bd1-4fef-a8a2-1e95224823f9', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:15:52.258046 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:15:52.258046 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:15:52.258046 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:15:52.258772 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:15:52.259274 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:15:52.268304 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:52.268868 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:52.269754 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:52.270249 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:52.287340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Getting quotas for project dc51e914f5e74ceca4086caa5a05b8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:15:52.291540 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Getting quotas for user 882a63823deb40dcb93ddc76f81ab9d0 and project dc51e914f5e74ceca4086caa5a05b8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:15:52.302449 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:15:52.304696 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:15:52.448108 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c32f2968-1eff-4148-8d32-bf128fde8660 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640270 Nov 23 04:15:52.449150 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 129/246] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:15:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:15:52.453410 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-08e3998a-cb26-4658-8db8-7bc0af00eafb tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:52.454093 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-08e3998a-cb26-4658-8db8-7bc0af00eafb tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:52.515923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-08e3998a-cb26-4658-8db8-7bc0af00eafb tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:52.523600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-08e3998a-cb26-4658-8db8-7bc0af00eafb tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1215 microversion: 2.1 time: 0.073414 Nov 23 04:15:52.524239 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 130/247] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:52 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:52.529299 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d3de725f-8283-4e91-ac14-01a19ba4e141 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:52.530128 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d3de725f-8283-4e91-ac14-01a19ba4e141 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:52.537465 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d3de725f-8283-4e91-ac14-01a19ba4e141 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:52.538010 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d3de725f-8283-4e91-ac14-01a19ba4e141 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:52.540135 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d3de725f-8283-4e91-ac14-01a19ba4e141 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:52.540135 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d3de725f-8283-4e91-ac14-01a19ba4e141 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:52.708081 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d3de725f-8283-4e91-ac14-01a19ba4e141 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:52.717356 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d3de725f-8283-4e91-ac14-01a19ba4e141 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.191755 Nov 23 04:15:52.717964 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 131/248] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:52 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:52.731474 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b14cccf7-070e-4d6f-8956-857285e11315 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:52.732084 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b14cccf7-070e-4d6f-8956-857285e11315 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:52.786323 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b14cccf7-070e-4d6f-8956-857285e11315 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:52.793474 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b14cccf7-070e-4d6f-8956-857285e11315 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1217 microversion: 2.1 time: 0.074412 Nov 23 04:15:52.794082 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 132/249] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:52 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:53.541421 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-477c895a-1638-4ec3-8981-0217926827d6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:53.542168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-477c895a-1638-4ec3-8981-0217926827d6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:53.547917 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-477c895a-1638-4ec3-8981-0217926827d6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:53.548366 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-477c895a-1638-4ec3-8981-0217926827d6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:53.549140 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-477c895a-1638-4ec3-8981-0217926827d6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:53.549613 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-477c895a-1638-4ec3-8981-0217926827d6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:53.609404 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-477c895a-1638-4ec3-8981-0217926827d6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:53.616630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-477c895a-1638-4ec3-8981-0217926827d6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1219 microversion: 2.1 time: 0.079230 Nov 23 04:15:53.617191 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 133/250] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:53 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:53.734339 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f6fe4f2f-dbb5-4d73-ac71-58b656aaa86c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:53.735002 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f6fe4f2f-dbb5-4d73-ac71-58b656aaa86c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:53.741580 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f6fe4f2f-dbb5-4d73-ac71-58b656aaa86c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:53.742019 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f6fe4f2f-dbb5-4d73-ac71-58b656aaa86c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:53.742873 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f6fe4f2f-dbb5-4d73-ac71-58b656aaa86c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:53.743445 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f6fe4f2f-dbb5-4d73-ac71-58b656aaa86c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:53.886628 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f6fe4f2f-dbb5-4d73-ac71-58b656aaa86c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:53.886822 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5de7385f-81a0-4585-9461-38bfdcd514e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28627 microversion: 2.20 time: 2.877481 Nov 23 04:15:53.886822 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 118/251] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:51 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28627 bytes in 2879 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:15:53.887857 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f6fe4f2f-dbb5-4d73-ac71-58b656aaa86c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.156449 Nov 23 04:15:53.888959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 134/252] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:53 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:53.889762 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d278795f-8d0d-46fa-9d89-f489ee29ef69 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:53.890669 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d278795f-8d0d-46fa-9d89-f489ee29ef69 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:53.900730 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d278795f-8d0d-46fa-9d89-f489ee29ef69 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:53.901272 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d278795f-8d0d-46fa-9d89-f489ee29ef69 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:53.902052 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d278795f-8d0d-46fa-9d89-f489ee29ef69 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:53.902507 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d278795f-8d0d-46fa-9d89-f489ee29ef69 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:53.971526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d278795f-8d0d-46fa-9d89-f489ee29ef69 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:53.975647 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d278795f-8d0d-46fa-9d89-f489ee29ef69 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1221 microversion: 2.1 time: 0.090142 Nov 23 04:15:53.976274 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 119/253] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:53 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:54.633630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8617c5c8-0ece-46bb-9aa9-7d3407601d4e tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:54.634237 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8617c5c8-0ece-46bb-9aa9-7d3407601d4e tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:54.640655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8617c5c8-0ece-46bb-9aa9-7d3407601d4e tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:54.641094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8617c5c8-0ece-46bb-9aa9-7d3407601d4e tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:54.641858 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8617c5c8-0ece-46bb-9aa9-7d3407601d4e tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:54.642283 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8617c5c8-0ece-46bb-9aa9-7d3407601d4e tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:54.704220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8617c5c8-0ece-46bb-9aa9-7d3407601d4e tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:54.711824 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8617c5c8-0ece-46bb-9aa9-7d3407601d4e tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1211 microversion: 2.1 time: 0.081805 Nov 23 04:15:54.712394 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 135/254] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:54 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:54.900726 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fd322e47-eff3-437b-907e-df819149f19d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:54.901754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fd322e47-eff3-437b-907e-df819149f19d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:54.903755 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2f812c05-e9ec-45e8-b161-d4479d87a832 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:54.907901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2f812c05-e9ec-45e8-b161-d4479d87a832 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:54.908587 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd322e47-eff3-437b-907e-df819149f19d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:54.908587 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd322e47-eff3-437b-907e-df819149f19d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:54.909341 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd322e47-eff3-437b-907e-df819149f19d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:54.909772 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd322e47-eff3-437b-907e-df819149f19d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:54.910519 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f812c05-e9ec-45e8-b161-d4479d87a832 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:54.910955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f812c05-e9ec-45e8-b161-d4479d87a832 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:54.911784 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f812c05-e9ec-45e8-b161-d4479d87a832 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:54.912203 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f812c05-e9ec-45e8-b161-d4479d87a832 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:55.045463 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2f812c05-e9ec-45e8-b161-d4479d87a832 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:55.053263 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2f812c05-e9ec-45e8-b161-d4479d87a832 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.153205 Nov 23 04:15:55.053829 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 136/255] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:54 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:55.058540 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f5c92f60-ecdd-4354-9796-750ec97feeb9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:55.059402 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f5c92f60-ecdd-4354-9796-750ec97feeb9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:55.065431 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f5c92f60-ecdd-4354-9796-750ec97feeb9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:55.065875 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f5c92f60-ecdd-4354-9796-750ec97feeb9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:55.066657 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f5c92f60-ecdd-4354-9796-750ec97feeb9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:55.067087 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f5c92f60-ecdd-4354-9796-750ec97feeb9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:55.129339 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f5c92f60-ecdd-4354-9796-750ec97feeb9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:55.136778 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f5c92f60-ecdd-4354-9796-750ec97feeb9 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1269 microversion: 2.1 time: 0.082024 Nov 23 04:15:55.137335 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 137/256] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:55 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:55.729674 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-07f7c275-6f95-408f-a9e4-dba07ee04e0c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:55.730330 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-07f7c275-6f95-408f-a9e4-dba07ee04e0c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:55.736245 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-07f7c275-6f95-408f-a9e4-dba07ee04e0c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:55.740742 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-07f7c275-6f95-408f-a9e4-dba07ee04e0c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:55.740742 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-07f7c275-6f95-408f-a9e4-dba07ee04e0c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:55.740742 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-07f7c275-6f95-408f-a9e4-dba07ee04e0c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:55.796500 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-07f7c275-6f95-408f-a9e4-dba07ee04e0c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:55.803928 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-07f7c275-6f95-408f-a9e4-dba07ee04e0c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1211 microversion: 2.1 time: 0.078104 Nov 23 04:15:55.804490 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 138/257] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:55 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:56.077416 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5a601a3c-d26d-45c1-a058-0f5a153c9a03 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:56.078019 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5a601a3c-d26d-45c1-a058-0f5a153c9a03 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:56.084277 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5a601a3c-d26d-45c1-a058-0f5a153c9a03 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:56.084721 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5a601a3c-d26d-45c1-a058-0f5a153c9a03 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:56.085488 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5a601a3c-d26d-45c1-a058-0f5a153c9a03 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:56.085922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5a601a3c-d26d-45c1-a058-0f5a153c9a03 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:56.217346 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5a601a3c-d26d-45c1-a058-0f5a153c9a03 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:56.224827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5a601a3c-d26d-45c1-a058-0f5a153c9a03 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.150961 Nov 23 04:15:56.225401 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 139/258] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:56 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:56.230467 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3831a567-6b49-403f-b282-cdc49baf3374 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:56.231078 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3831a567-6b49-403f-b282-cdc49baf3374 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:56.236674 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3831a567-6b49-403f-b282-cdc49baf3374 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:56.237113 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3831a567-6b49-403f-b282-cdc49baf3374 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:56.237906 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3831a567-6b49-403f-b282-cdc49baf3374 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:56.238550 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3831a567-6b49-403f-b282-cdc49baf3374 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:56.297168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3831a567-6b49-403f-b282-cdc49baf3374 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:56.304521 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3831a567-6b49-403f-b282-cdc49baf3374 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1269 microversion: 2.1 time: 0.078152 Nov 23 04:15:56.305081 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 140/259] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:56 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1269 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:56.821268 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ed5c0dbd-0a1f-4143-92a6-e7b90b4ebaf7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:56.821910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ed5c0dbd-0a1f-4143-92a6-e7b90b4ebaf7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:56.827794 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed5c0dbd-0a1f-4143-92a6-e7b90b4ebaf7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:56.828249 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed5c0dbd-0a1f-4143-92a6-e7b90b4ebaf7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:56.829019 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed5c0dbd-0a1f-4143-92a6-e7b90b4ebaf7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:56.829454 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed5c0dbd-0a1f-4143-92a6-e7b90b4ebaf7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:56.886843 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ed5c0dbd-0a1f-4143-92a6-e7b90b4ebaf7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:56.893928 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ed5c0dbd-0a1f-4143-92a6-e7b90b4ebaf7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1211 microversion: 2.1 time: 0.076301 Nov 23 04:15:56.894496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 141/260] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:56 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1211 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:57.242393 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-be536e14-22cc-4897-8ba6-3c96e7935caf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:57.243003 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-be536e14-22cc-4897-8ba6-3c96e7935caf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:57.249269 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be536e14-22cc-4897-8ba6-3c96e7935caf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:57.249711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be536e14-22cc-4897-8ba6-3c96e7935caf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:57.250491 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be536e14-22cc-4897-8ba6-3c96e7935caf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:57.250930 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be536e14-22cc-4897-8ba6-3c96e7935caf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:57.383557 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-be536e14-22cc-4897-8ba6-3c96e7935caf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:57.391469 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-be536e14-22cc-4897-8ba6-3c96e7935caf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.152668 Nov 23 04:15:57.392034 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 142/261] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:57 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:15:57.396158 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a1e708d4-770f-4ee3-a86e-a335a53e4ef2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:57.396747 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a1e708d4-770f-4ee3-a86e-a335a53e4ef2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:57.402730 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1e708d4-770f-4ee3-a86e-a335a53e4ef2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:57.403176 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1e708d4-770f-4ee3-a86e-a335a53e4ef2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:57.403987 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1e708d4-770f-4ee3-a86e-a335a53e4ef2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:57.404413 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1e708d4-770f-4ee3-a86e-a335a53e4ef2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:57.464497 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a1e708d4-770f-4ee3-a86e-a335a53e4ef2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:57.466094 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fd322e47-eff3-437b-907e-df819149f19d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28627 microversion: 2.20 time: 2.569375 Nov 23 04:15:57.466734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 120/262] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:54 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28627 bytes in 2571 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:57.472004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a1e708d4-770f-4ee3-a86e-a335a53e4ef2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1269 microversion: 2.1 time: 0.078932 Nov 23 04:15:57.472500 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 143/263] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:57 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1269 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:57.911780 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7b90d86c-b484-493b-9cfd-ab88f8faab01 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:57.914118 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7b90d86c-b484-493b-9cfd-ab88f8faab01 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:57.920907 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7b90d86c-b484-493b-9cfd-ab88f8faab01 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:57.921393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7b90d86c-b484-493b-9cfd-ab88f8faab01 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:57.922178 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7b90d86c-b484-493b-9cfd-ab88f8faab01 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:57.922613 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7b90d86c-b484-493b-9cfd-ab88f8faab01 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:57.984730 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7b90d86c-b484-493b-9cfd-ab88f8faab01 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:57.992049 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7b90d86c-b484-493b-9cfd-ab88f8faab01 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1211 microversion: 2.1 time: 0.084448 Nov 23 04:15:57.992611 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 121/264] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:57 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:58.408497 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-91b24532-3f8c-4c47-9675-a5f403ebfc10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:58.409113 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-91b24532-3f8c-4c47-9675-a5f403ebfc10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:58.416583 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-91b24532-3f8c-4c47-9675-a5f403ebfc10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:58.417124 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-91b24532-3f8c-4c47-9675-a5f403ebfc10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:58.418002 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-91b24532-3f8c-4c47-9675-a5f403ebfc10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:58.418371 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-91b24532-3f8c-4c47-9675-a5f403ebfc10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:58.479451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0b1d4c48-3f24-45ab-a9ae-b37a0a8c95ca tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:58.481846 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0b1d4c48-3f24-45ab-a9ae-b37a0a8c95ca tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:58.488978 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0b1d4c48-3f24-45ab-a9ae-b37a0a8c95ca tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:58.489591 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0b1d4c48-3f24-45ab-a9ae-b37a0a8c95ca tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:58.495845 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0b1d4c48-3f24-45ab-a9ae-b37a0a8c95ca tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:58.496373 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0b1d4c48-3f24-45ab-a9ae-b37a0a8c95ca tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:58.694576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-91b24532-3f8c-4c47-9675-a5f403ebfc10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:58.702431 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0b1d4c48-3f24-45ab-a9ae-b37a0a8c95ca tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28627 microversion: 2.20 time: 0.227399 Nov 23 04:15:58.706266 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 122/265] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:58 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28627 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:58.709305 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-91b24532-3f8c-4c47-9675-a5f403ebfc10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.304322 Nov 23 04:15:58.712306 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1ba29c69-3991-4d23-8bbd-1a7dc28aa767 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:58.713468 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1ba29c69-3991-4d23-8bbd-1a7dc28aa767 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:58.723417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 144/266] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:58 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:58.737251 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ba29c69-3991-4d23-8bbd-1a7dc28aa767 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:58.737706 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ba29c69-3991-4d23-8bbd-1a7dc28aa767 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:58.738497 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ba29c69-3991-4d23-8bbd-1a7dc28aa767 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:58.738958 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ba29c69-3991-4d23-8bbd-1a7dc28aa767 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:58.814957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1ba29c69-3991-4d23-8bbd-1a7dc28aa767 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:58.830734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1ba29c69-3991-4d23-8bbd-1a7dc28aa767 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1275 microversion: 2.1 time: 0.121257 Nov 23 04:15:58.830734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 123/267] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:58 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:59.009330 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e0f6c423-3066-456d-99dc-b7f0f4a66063 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:59.010169 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e0f6c423-3066-456d-99dc-b7f0f4a66063 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:59.019298 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e0f6c423-3066-456d-99dc-b7f0f4a66063 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:59.023776 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e0f6c423-3066-456d-99dc-b7f0f4a66063 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:59.024875 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e0f6c423-3066-456d-99dc-b7f0f4a66063 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:59.025740 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e0f6c423-3066-456d-99dc-b7f0f4a66063 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:59.418518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e0f6c423-3066-456d-99dc-b7f0f4a66063 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:15:59.425868 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e0f6c423-3066-456d-99dc-b7f0f4a66063 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1275 microversion: 2.1 time: 0.420094 Nov 23 04:15:59.426538 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 145/268] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:59 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1275 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:15:59.714444 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-66005501-99f1-4cf6-abdb-92e4aab55a85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:15:59.715471 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-66005501-99f1-4cf6-abdb-92e4aab55a85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:59.721766 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-66005501-99f1-4cf6-abdb-92e4aab55a85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:59.722318 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-66005501-99f1-4cf6-abdb-92e4aab55a85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:59.723164 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-66005501-99f1-4cf6-abdb-92e4aab55a85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:59.723712 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-66005501-99f1-4cf6-abdb-92e4aab55a85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:59.740522 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7d230bf3-5ed1-4ee7-ad64-ea4a70c62411 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:59.741684 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7d230bf3-5ed1-4ee7-ad64-ea4a70c62411 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:59.753024 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7d230bf3-5ed1-4ee7-ad64-ea4a70c62411 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:59.753024 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7d230bf3-5ed1-4ee7-ad64-ea4a70c62411 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:59.753024 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7d230bf3-5ed1-4ee7-ad64-ea4a70c62411 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:59.753024 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7d230bf3-5ed1-4ee7-ad64-ea4a70c62411 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:59.840124 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-66005501-99f1-4cf6-abdb-92e4aab55a85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28627 microversion: 2.20 time: 0.129645 Nov 23 04:15:59.845013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 124/269] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:15:59 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28627 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:15:59.850690 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e6a36311-aac9-4786-9c00-3e8756ebd0ed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:15:59.851411 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e6a36311-aac9-4786-9c00-3e8756ebd0ed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:15:59.858961 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e6a36311-aac9-4786-9c00-3e8756ebd0ed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:59.859521 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e6a36311-aac9-4786-9c00-3e8756ebd0ed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:15:59.860313 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e6a36311-aac9-4786-9c00-3e8756ebd0ed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:15:59.860751 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e6a36311-aac9-4786-9c00-3e8756ebd0ed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:00.196214 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-7d230bf3-5ed1-4ee7-ad64-ea4a70c62411 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:00.204334 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7d230bf3-5ed1-4ee7-ad64-ea4a70c62411 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.467456 Nov 23 04:16:00.204981 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 146/270] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:59 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:00.247973 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e6a36311-aac9-4786-9c00-3e8756ebd0ed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:00.255571 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e6a36311-aac9-4786-9c00-3e8756ebd0ed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.410805 Nov 23 04:16:00.257039 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 125/271] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:15:59 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:00.443955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-298b9a52-3ca4-4709-977d-19b903c7261c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:00.444577 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-298b9a52-3ca4-4709-977d-19b903c7261c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:00.451722 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-298b9a52-3ca4-4709-977d-19b903c7261c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:00.452171 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-298b9a52-3ca4-4709-977d-19b903c7261c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:00.452959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-298b9a52-3ca4-4709-977d-19b903c7261c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:00.453394 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-298b9a52-3ca4-4709-977d-19b903c7261c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:00.545738 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-298b9a52-3ca4-4709-977d-19b903c7261c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:00.552942 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-298b9a52-3ca4-4709-977d-19b903c7261c tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1273 microversion: 2.1 time: 0.112667 Nov 23 04:16:00.553504 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 147/272] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:00 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:00.855010 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9ffca19f-1dcc-4700-9677-6f65ec3cc9a0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:00.856169 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9ffca19f-1dcc-4700-9677-6f65ec3cc9a0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:00.866295 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9ffca19f-1dcc-4700-9677-6f65ec3cc9a0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:00.866295 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9ffca19f-1dcc-4700-9677-6f65ec3cc9a0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:00.867389 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9ffca19f-1dcc-4700-9677-6f65ec3cc9a0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:00.868009 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9ffca19f-1dcc-4700-9677-6f65ec3cc9a0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:00.981720 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-48c25b3b-4dff-4eb5-98c4-37b7136e7993 req-ba6f2a08-e523-4eb8-8321-776e43d20f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf175718-dca3-4da3-a676-f5d4d54f54e2", "tag": "c6aef10d-8d5c-41bc-b91c-795812fa4860"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:00.983368 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:16:00.983368 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:16:00.991797 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-48c25b3b-4dff-4eb5-98c4-37b7136e7993 req-ba6f2a08-e523-4eb8-8321-776e43d20f5e service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:00.992461 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-48c25b3b-4dff-4eb5-98c4-37b7136e7993 req-ba6f2a08-e523-4eb8-8321-776e43d20f5e service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:01.020146 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-48c25b3b-4dff-4eb5-98c4-37b7136e7993 req-ba6f2a08-e523-4eb8-8321-776e43d20f5e service nova] Creating event network-changed:c6aef10d-8d5c-41bc-b91c-795812fa4860 for instance cf175718-dca3-4da3-a676-f5d4d54f54e2 on hv-cinder-76845 Nov 23 04:16:01.033844 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-48c25b3b-4dff-4eb5-98c4-37b7136e7993 req-ba6f2a08-e523-4eb8-8321-776e43d20f5e service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048647 Nov 23 04:16:01.033844 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 148/273] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:16:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:16:01.222341 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ec7c091d-031d-426f-a3ce-48ddf38cd3dd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:01.222964 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ec7c091d-031d-426f-a3ce-48ddf38cd3dd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:01.229974 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ec7c091d-031d-426f-a3ce-48ddf38cd3dd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:01.230437 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ec7c091d-031d-426f-a3ce-48ddf38cd3dd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:01.231257 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ec7c091d-031d-426f-a3ce-48ddf38cd3dd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:01.231700 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ec7c091d-031d-426f-a3ce-48ddf38cd3dd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:01.373904 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ec7c091d-031d-426f-a3ce-48ddf38cd3dd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:01.381189 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ec7c091d-031d-426f-a3ce-48ddf38cd3dd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.163000 Nov 23 04:16:01.381746 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 149/274] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:01 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:01.386405 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-007647a6-89f4-4013-b149-66bc8635e148 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:01.387001 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-007647a6-89f4-4013-b149-66bc8635e148 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:01.392326 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-007647a6-89f4-4013-b149-66bc8635e148 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:01.392771 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-007647a6-89f4-4013-b149-66bc8635e148 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:01.393544 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-007647a6-89f4-4013-b149-66bc8635e148 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:01.393980 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-007647a6-89f4-4013-b149-66bc8635e148 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:01.527042 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-007647a6-89f4-4013-b149-66bc8635e148 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:01.534349 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-007647a6-89f4-4013-b149-66bc8635e148 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.151681 Nov 23 04:16:01.534912 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 150/275] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:01 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:01.571479 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a4e1edd5-917a-403a-8241-021f2acdabf9 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:01.572012 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a4e1edd5-917a-403a-8241-021f2acdabf9 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:01.577862 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4e1edd5-917a-403a-8241-021f2acdabf9 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:01.578305 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4e1edd5-917a-403a-8241-021f2acdabf9 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:01.579077 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4e1edd5-917a-403a-8241-021f2acdabf9 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:01.579539 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4e1edd5-917a-403a-8241-021f2acdabf9 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:01.707554 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a4e1edd5-917a-403a-8241-021f2acdabf9 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:01.715191 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a4e1edd5-917a-403a-8241-021f2acdabf9 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.147252 Nov 23 04:16:01.715774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 151/276] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:01 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:02.397618 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5cb03724-2fdc-4e5e-ae38-2d8dfcc82367 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:02.398327 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5cb03724-2fdc-4e5e-ae38-2d8dfcc82367 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:02.404240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5cb03724-2fdc-4e5e-ae38-2d8dfcc82367 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:02.404680 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5cb03724-2fdc-4e5e-ae38-2d8dfcc82367 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:02.408883 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5cb03724-2fdc-4e5e-ae38-2d8dfcc82367 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:02.408883 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5cb03724-2fdc-4e5e-ae38-2d8dfcc82367 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:02.539519 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5cb03724-2fdc-4e5e-ae38-2d8dfcc82367 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:02.547457 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5cb03724-2fdc-4e5e-ae38-2d8dfcc82367 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.153447 Nov 23 04:16:02.548023 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 152/277] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:02 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:02.552193 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-818ba910-a596-46d9-bc70-627cba8f4421 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:02.552991 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-818ba910-a596-46d9-bc70-627cba8f4421 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:02.559460 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-818ba910-a596-46d9-bc70-627cba8f4421 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:02.559867 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-818ba910-a596-46d9-bc70-627cba8f4421 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:02.560666 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-818ba910-a596-46d9-bc70-627cba8f4421 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:02.561092 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-818ba910-a596-46d9-bc70-627cba8f4421 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:02.696854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-818ba910-a596-46d9-bc70-627cba8f4421 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:02.704636 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-818ba910-a596-46d9-bc70-627cba8f4421 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.155674 Nov 23 04:16:02.705197 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 153/278] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:02 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:02.731909 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c52bee9d-2724-4f40-818a-a35586ece8c7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:02.732535 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c52bee9d-2724-4f40-818a-a35586ece8c7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:02.738145 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c52bee9d-2724-4f40-818a-a35586ece8c7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:02.738586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c52bee9d-2724-4f40-818a-a35586ece8c7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:02.739380 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c52bee9d-2724-4f40-818a-a35586ece8c7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:02.739811 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c52bee9d-2724-4f40-818a-a35586ece8c7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:02.868724 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c52bee9d-2724-4f40-818a-a35586ece8c7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:02.876070 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c52bee9d-2724-4f40-818a-a35586ece8c7 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.147846 Nov 23 04:16:02.876630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 154/279] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:02 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:03.236040 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9ffca19f-1dcc-4700-9677-6f65ec3cc9a0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28627 microversion: 2.20 time: 2.385262 Nov 23 04:16:03.237960 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 126/280] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:00 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28627 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:16:03.564891 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4d7130ac-2525-4f47-a50b-f62e09fc59ed tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:03.565493 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4d7130ac-2525-4f47-a50b-f62e09fc59ed tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:03.571929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d7130ac-2525-4f47-a50b-f62e09fc59ed tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:03.573144 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d7130ac-2525-4f47-a50b-f62e09fc59ed tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:03.573941 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d7130ac-2525-4f47-a50b-f62e09fc59ed tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:03.574376 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d7130ac-2525-4f47-a50b-f62e09fc59ed tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:03.722378 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-47ff4b00-9323-49bd-b1b6-8564e37e58d3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:03.723203 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-47ff4b00-9323-49bd-b1b6-8564e37e58d3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:03.730284 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-47ff4b00-9323-49bd-b1b6-8564e37e58d3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:03.731419 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-47ff4b00-9323-49bd-b1b6-8564e37e58d3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:03.731678 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-47ff4b00-9323-49bd-b1b6-8564e37e58d3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:03.732114 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-47ff4b00-9323-49bd-b1b6-8564e37e58d3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:03.966343 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4d7130ac-2525-4f47-a50b-f62e09fc59ed tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:03.974125 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4d7130ac-2525-4f47-a50b-f62e09fc59ed tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.412960 Nov 23 04:16:03.975073 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 155/281] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:03 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:03.980846 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a1fb0ee1-727d-4fcf-970e-6e109ee4a036 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:03.981454 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a1fb0ee1-727d-4fcf-970e-6e109ee4a036 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:03.987577 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1fb0ee1-727d-4fcf-970e-6e109ee4a036 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:03.992076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1fb0ee1-727d-4fcf-970e-6e109ee4a036 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:03.992076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1fb0ee1-727d-4fcf-970e-6e109ee4a036 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:03.992076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1fb0ee1-727d-4fcf-970e-6e109ee4a036 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:04.086414 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-47ff4b00-9323-49bd-b1b6-8564e37e58d3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:04.101919 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-47ff4b00-9323-49bd-b1b6-8564e37e58d3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.383450 Nov 23 04:16:04.102506 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 127/282] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:03 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:04.249903 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f10f6b31-bc74-4eb2-9065-cd1f4c9be620 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:04.251814 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f10f6b31-bc74-4eb2-9065-cd1f4c9be620 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:04.258937 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a1fb0ee1-727d-4fcf-970e-6e109ee4a036 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:04.260321 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f10f6b31-bc74-4eb2-9065-cd1f4c9be620 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:04.260980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f10f6b31-bc74-4eb2-9065-cd1f4c9be620 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:04.262209 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f10f6b31-bc74-4eb2-9065-cd1f4c9be620 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:04.263037 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f10f6b31-bc74-4eb2-9065-cd1f4c9be620 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:04.268423 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a1fb0ee1-727d-4fcf-970e-6e109ee4a036 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.292100 Nov 23 04:16:04.269297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 156/283] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:03 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:04.559310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-72946394-b74c-46da-b1ea-a577c62b8b83 req-b9e5092a-4d53-4c3f-a69b-26a638035849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9da592d1-d534-4643-8e5f-35edefd614b4", "tag": "2c6f1671-b600-4d12-99a6-94d877dbbfeb"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:04.559310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:16:04.559310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:16:04.563233 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-72946394-b74c-46da-b1ea-a577c62b8b83 req-b9e5092a-4d53-4c3f-a69b-26a638035849 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:04.563677 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-72946394-b74c-46da-b1ea-a577c62b8b83 req-b9e5092a-4d53-4c3f-a69b-26a638035849 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:04.575774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-72946394-b74c-46da-b1ea-a577c62b8b83 req-b9e5092a-4d53-4c3f-a69b-26a638035849 service nova] Creating event network-changed:2c6f1671-b600-4d12-99a6-94d877dbbfeb for instance 9da592d1-d534-4643-8e5f-35edefd614b4 on hv-cinder-76845 Nov 23 04:16:04.580472 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-72946394-b74c-46da-b1ea-a577c62b8b83 req-b9e5092a-4d53-4c3f-a69b-26a638035849 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033553 Nov 23 04:16:04.581258 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 157/284] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:16:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:16:04.991439 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7241826e-421f-4be4-ac2d-759a3b964d04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:04.992132 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7241826e-421f-4be4-ac2d-759a3b964d04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:04.998145 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7241826e-421f-4be4-ac2d-759a3b964d04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:04.998596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7241826e-421f-4be4-ac2d-759a3b964d04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:04.999464 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7241826e-421f-4be4-ac2d-759a3b964d04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:04.999902 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7241826e-421f-4be4-ac2d-759a3b964d04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:05.136151 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-7241826e-421f-4be4-ac2d-759a3b964d04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:05.143346 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7241826e-421f-4be4-ac2d-759a3b964d04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.155946 Nov 23 04:16:05.154421 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 158/285] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:04 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:05.154421 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-50603f0d-0c6e-483e-a32d-63e518b78fe8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:05.154421 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-50603f0d-0c6e-483e-a32d-63e518b78fe8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:05.155050 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-50603f0d-0c6e-483e-a32d-63e518b78fe8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:05.155533 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-50603f0d-0c6e-483e-a32d-63e518b78fe8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:05.156294 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-50603f0d-0c6e-483e-a32d-63e518b78fe8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:05.156723 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-50603f0d-0c6e-483e-a32d-63e518b78fe8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:05.287377 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-50603f0d-0c6e-483e-a32d-63e518b78fe8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:05.295053 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-50603f0d-0c6e-483e-a32d-63e518b78fe8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.150121 Nov 23 04:16:05.295651 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 159/286] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:05 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:05.304437 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4c754f84-8ad1-48a4-bffe-337090636732 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:05.304437 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4c754f84-8ad1-48a4-bffe-337090636732 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:05.305907 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4c754f84-8ad1-48a4-bffe-337090636732 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:05.306347 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4c754f84-8ad1-48a4-bffe-337090636732 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:05.307829 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4c754f84-8ad1-48a4-bffe-337090636732 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:05.307943 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4c754f84-8ad1-48a4-bffe-337090636732 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:05.439370 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4c754f84-8ad1-48a4-bffe-337090636732 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:05.447826 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4c754f84-8ad1-48a4-bffe-337090636732 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.150522 Nov 23 04:16:05.448390 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 160/287] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:05 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:06.161693 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-888ebfaa-fb82-42cf-8ab5-d63fe6048601 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:06.162440 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-888ebfaa-fb82-42cf-8ab5-d63fe6048601 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:06.169336 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-888ebfaa-fb82-42cf-8ab5-d63fe6048601 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:06.169800 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-888ebfaa-fb82-42cf-8ab5-d63fe6048601 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:06.170562 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-888ebfaa-fb82-42cf-8ab5-d63fe6048601 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:06.171004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-888ebfaa-fb82-42cf-8ab5-d63fe6048601 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:06.303700 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-888ebfaa-fb82-42cf-8ab5-d63fe6048601 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:06.311099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-888ebfaa-fb82-42cf-8ab5-d63fe6048601 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.153152 Nov 23 04:16:06.311832 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 161/288] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:06 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:06.316169 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0daccf91-50ef-4ad9-a23f-ec811ad8e098 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:06.316928 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0daccf91-50ef-4ad9-a23f-ec811ad8e098 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:06.322569 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0daccf91-50ef-4ad9-a23f-ec811ad8e098 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:06.323097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0daccf91-50ef-4ad9-a23f-ec811ad8e098 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:06.323915 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0daccf91-50ef-4ad9-a23f-ec811ad8e098 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:06.324344 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0daccf91-50ef-4ad9-a23f-ec811ad8e098 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:06.464125 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0daccf91-50ef-4ad9-a23f-ec811ad8e098 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:06.471918 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0daccf91-50ef-4ad9-a23f-ec811ad8e098 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.158967 Nov 23 04:16:06.475247 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 162/289] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:06 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:06.479064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c468d1e0-0ece-4fc7-852d-f690b6f59f90 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:06.479064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c468d1e0-0ece-4fc7-852d-f690b6f59f90 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:06.486428 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c468d1e0-0ece-4fc7-852d-f690b6f59f90 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:06.486876 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c468d1e0-0ece-4fc7-852d-f690b6f59f90 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:06.487672 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c468d1e0-0ece-4fc7-852d-f690b6f59f90 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:06.488676 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c468d1e0-0ece-4fc7-852d-f690b6f59f90 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:06.636307 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f10f6b31-bc74-4eb2-9065-cd1f4c9be620 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28627 microversion: 2.20 time: 2.390686 Nov 23 04:16:06.639251 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 128/290] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:04 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28627 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:16:06.661638 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c468d1e0-0ece-4fc7-852d-f690b6f59f90 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:06.669841 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c468d1e0-0ece-4fc7-852d-f690b6f59f90 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.196033 Nov 23 04:16:06.670611 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 163/291] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:06 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:07.329010 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-34b8f371-e54e-4e62-95a3-6540ffc121dc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:07.329731 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-34b8f371-e54e-4e62-95a3-6540ffc121dc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:07.336626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-34b8f371-e54e-4e62-95a3-6540ffc121dc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:07.337081 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-34b8f371-e54e-4e62-95a3-6540ffc121dc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:07.338726 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-34b8f371-e54e-4e62-95a3-6540ffc121dc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:07.339399 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-34b8f371-e54e-4e62-95a3-6540ffc121dc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:07.490913 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6b070b5d-f8ed-4de9-9809-0752662a242c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:07.491571 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6b070b5d-f8ed-4de9-9809-0752662a242c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:07.501865 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6b070b5d-f8ed-4de9-9809-0752662a242c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:07.502780 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6b070b5d-f8ed-4de9-9809-0752662a242c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:07.503744 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6b070b5d-f8ed-4de9-9809-0752662a242c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:07.505275 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6b070b5d-f8ed-4de9-9809-0752662a242c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:07.933728 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-34b8f371-e54e-4e62-95a3-6540ffc121dc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:07.941530 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-34b8f371-e54e-4e62-95a3-6540ffc121dc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.616347 Nov 23 04:16:07.946450 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 129/292] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:07 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:07.946968 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-761fb245-accd-4e77-854c-72f06f2870b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:07.949290 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-761fb245-accd-4e77-854c-72f06f2870b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:07.955490 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-761fb245-accd-4e77-854c-72f06f2870b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:07.956163 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-761fb245-accd-4e77-854c-72f06f2870b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:07.956957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-761fb245-accd-4e77-854c-72f06f2870b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:07.957425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-761fb245-accd-4e77-854c-72f06f2870b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:07.960975 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6b070b5d-f8ed-4de9-9809-0752662a242c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:07.969171 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6b070b5d-f8ed-4de9-9809-0752662a242c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.483403 Nov 23 04:16:07.969907 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 164/293] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:07 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:07.975953 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-eb547214-1762-4695-8a36-cc49110cc432 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:07.978087 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-eb547214-1762-4695-8a36-cc49110cc432 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:07.983563 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eb547214-1762-4695-8a36-cc49110cc432 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:07.984242 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eb547214-1762-4695-8a36-cc49110cc432 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:07.985025 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eb547214-1762-4695-8a36-cc49110cc432 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:07.985451 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eb547214-1762-4695-8a36-cc49110cc432 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:08.125514 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-eb547214-1762-4695-8a36-cc49110cc432 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:08.133051 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-eb547214-1762-4695-8a36-cc49110cc432 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.161840 Nov 23 04:16:08.133605 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 165/294] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:07 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:08.339985 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-761fb245-accd-4e77-854c-72f06f2870b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28627 microversion: 2.20 time: 0.396300 Nov 23 04:16:08.340662 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 130/295] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:07 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28627 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:16:08.958956 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c5aa3c31-0792-4ff6-9087-eab3cc91fc77 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:08.959623 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c5aa3c31-0792-4ff6-9087-eab3cc91fc77 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:08.966889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5aa3c31-0792-4ff6-9087-eab3cc91fc77 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:08.971698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5aa3c31-0792-4ff6-9087-eab3cc91fc77 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:08.971698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5aa3c31-0792-4ff6-9087-eab3cc91fc77 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:08.971698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5aa3c31-0792-4ff6-9087-eab3cc91fc77 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:08.986437 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1e7b955e-2805-4bf6-944d-0ae33d7ea125 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:08.987196 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1e7b955e-2805-4bf6-944d-0ae33d7ea125 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:08.996045 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e7b955e-2805-4bf6-944d-0ae33d7ea125 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:09.000264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e7b955e-2805-4bf6-944d-0ae33d7ea125 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:09.000264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e7b955e-2805-4bf6-944d-0ae33d7ea125 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:09.000264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e7b955e-2805-4bf6-944d-0ae33d7ea125 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:09.149526 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c5aa3c31-0792-4ff6-9087-eab3cc91fc77 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:09.157445 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c5aa3c31-0792-4ff6-9087-eab3cc91fc77 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.202038 Nov 23 04:16:09.158099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 166/296] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:08 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:09.162407 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-76977163-68cc-40dd-8ed5-d9b709641604 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:09.163083 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-76977163-68cc-40dd-8ed5-d9b709641604 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:09.169647 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76977163-68cc-40dd-8ed5-d9b709641604 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:09.170104 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76977163-68cc-40dd-8ed5-d9b709641604 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:09.170900 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76977163-68cc-40dd-8ed5-d9b709641604 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:09.171368 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76977163-68cc-40dd-8ed5-d9b709641604 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:09.177544 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1e7b955e-2805-4bf6-944d-0ae33d7ea125 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:09.185716 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1e7b955e-2805-4bf6-944d-0ae33d7ea125 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.203398 Nov 23 04:16:09.186245 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 131/297] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:08 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:09.301899 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-76977163-68cc-40dd-8ed5-d9b709641604 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:09.309273 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-76977163-68cc-40dd-8ed5-d9b709641604 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.150174 Nov 23 04:16:09.309840 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 167/298] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:09 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:09.351109 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1ef71256-68f9-436d-85d3-4fb27f200608 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:09.352034 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1ef71256-68f9-436d-85d3-4fb27f200608 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:09.359119 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ef71256-68f9-436d-85d3-4fb27f200608 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:09.359640 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ef71256-68f9-436d-85d3-4fb27f200608 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:09.360472 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ef71256-68f9-436d-85d3-4fb27f200608 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:09.360944 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ef71256-68f9-436d-85d3-4fb27f200608 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:10.175002 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0afb1a01-d0c9-4491-af1d-8a62006277c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:10.175634 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0afb1a01-d0c9-4491-af1d-8a62006277c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:10.182424 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0afb1a01-d0c9-4491-af1d-8a62006277c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:10.182866 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0afb1a01-d0c9-4491-af1d-8a62006277c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:10.183668 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0afb1a01-d0c9-4491-af1d-8a62006277c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:10.184102 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0afb1a01-d0c9-4491-af1d-8a62006277c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:10.313274 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0afb1a01-d0c9-4491-af1d-8a62006277c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:10.320846 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0afb1a01-d0c9-4491-af1d-8a62006277c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.149469 Nov 23 04:16:10.321460 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 168/299] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:10 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:10.325806 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5e1809e8-b616-423d-b4eb-d4cbd3a2f320 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:10.326410 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5e1809e8-b616-423d-b4eb-d4cbd3a2f320 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:10.331902 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5e1809e8-b616-423d-b4eb-d4cbd3a2f320 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:10.332344 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5e1809e8-b616-423d-b4eb-d4cbd3a2f320 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:10.333108 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5e1809e8-b616-423d-b4eb-d4cbd3a2f320 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:10.333542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5e1809e8-b616-423d-b4eb-d4cbd3a2f320 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:10.473558 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5e1809e8-b616-423d-b4eb-d4cbd3a2f320 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:10.481684 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5e1809e8-b616-423d-b4eb-d4cbd3a2f320 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.159246 Nov 23 04:16:10.482240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 169/300] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:10 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:10.486358 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e177c726-e0d5-4b5c-9e6b-c7c0f6a06d69 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:10.486954 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e177c726-e0d5-4b5c-9e6b-c7c0f6a06d69 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:10.492656 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e177c726-e0d5-4b5c-9e6b-c7c0f6a06d69 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:10.493097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e177c726-e0d5-4b5c-9e6b-c7c0f6a06d69 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:10.493858 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e177c726-e0d5-4b5c-9e6b-c7c0f6a06d69 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:10.495027 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e177c726-e0d5-4b5c-9e6b-c7c0f6a06d69 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:10.626863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e177c726-e0d5-4b5c-9e6b-c7c0f6a06d69 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:10.634361 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e177c726-e0d5-4b5c-9e6b-c7c0f6a06d69 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.151098 Nov 23 04:16:10.639345 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 170/301] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:10 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:11.338406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e7ee7a12-7479-42b1-837f-4642e4b63e14 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:11.339101 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e7ee7a12-7479-42b1-837f-4642e4b63e14 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:11.345358 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e7ee7a12-7479-42b1-837f-4642e4b63e14 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:11.345801 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e7ee7a12-7479-42b1-837f-4642e4b63e14 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:11.346569 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e7ee7a12-7479-42b1-837f-4642e4b63e14 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:11.346997 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e7ee7a12-7479-42b1-837f-4642e4b63e14 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:11.478718 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e7ee7a12-7479-42b1-837f-4642e4b63e14 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:11.486115 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e7ee7a12-7479-42b1-837f-4642e4b63e14 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.152188 Nov 23 04:16:11.486907 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 171/302] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:11 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:11.498120 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-65cbc65e-8126-4d0d-95d6-7fd883d7ce6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:11.498753 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-65cbc65e-8126-4d0d-95d6-7fd883d7ce6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:11.504435 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65cbc65e-8126-4d0d-95d6-7fd883d7ce6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:11.504878 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65cbc65e-8126-4d0d-95d6-7fd883d7ce6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:11.505648 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65cbc65e-8126-4d0d-95d6-7fd883d7ce6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:11.506080 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65cbc65e-8126-4d0d-95d6-7fd883d7ce6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:11.640156 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1ef71256-68f9-436d-85d3-4fb27f200608 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 28627 microversion: 2.20 time: 2.292469 Nov 23 04:16:11.640789 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-65cbc65e-8126-4d0d-95d6-7fd883d7ce6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:11.641449 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 132/303] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:09 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 28627 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:16:11.648290 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-65cbc65e-8126-4d0d-95d6-7fd883d7ce6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.154374 Nov 23 04:16:11.649013 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 172/304] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:11 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:11.654185 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-944992da-8f66-4a8b-a1d1-bb0b3f39d903 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:11.655143 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-944992da-8f66-4a8b-a1d1-bb0b3f39d903 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:11.663639 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-944992da-8f66-4a8b-a1d1-bb0b3f39d903 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:11.664754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-944992da-8f66-4a8b-a1d1-bb0b3f39d903 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:11.665760 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-944992da-8f66-4a8b-a1d1-bb0b3f39d903 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:11.666399 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-944992da-8f66-4a8b-a1d1-bb0b3f39d903 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:11.803542 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-944992da-8f66-4a8b-a1d1-bb0b3f39d903 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:11.811235 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-944992da-8f66-4a8b-a1d1-bb0b3f39d903 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.163235 Nov 23 04:16:11.811906 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 133/305] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:11 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:12.503098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bcb100c8-7f48-4ec5-903f-305a67bc9668 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:12.503797 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bcb100c8-7f48-4ec5-903f-305a67bc9668 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:12.510276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bcb100c8-7f48-4ec5-903f-305a67bc9668 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:12.510727 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bcb100c8-7f48-4ec5-903f-305a67bc9668 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:12.511523 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bcb100c8-7f48-4ec5-903f-305a67bc9668 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:12.511952 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bcb100c8-7f48-4ec5-903f-305a67bc9668 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:12.640523 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-bcb100c8-7f48-4ec5-903f-305a67bc9668 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:12.647828 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bcb100c8-7f48-4ec5-903f-305a67bc9668 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1521 microversion: 2.1 time: 0.148334 Nov 23 04:16:12.648383 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 173/306] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:12 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:12.653178 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5f66feb8-c2cf-4762-a618-5541ae09eab5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:12.654131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5f66feb8-c2cf-4762-a618-5541ae09eab5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:12.660755 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5f66feb8-c2cf-4762-a618-5541ae09eab5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:12.661204 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5f66feb8-c2cf-4762-a618-5541ae09eab5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:12.661957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5f66feb8-c2cf-4762-a618-5541ae09eab5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:12.662383 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5f66feb8-c2cf-4762-a618-5541ae09eab5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:12.664755 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3f916b05-10c2-4e3e-aa1e-2b70d20eab20 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:12.665354 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3f916b05-10c2-4e3e-aa1e-2b70d20eab20 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:12.671334 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3f916b05-10c2-4e3e-aa1e-2b70d20eab20 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:12.671787 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3f916b05-10c2-4e3e-aa1e-2b70d20eab20 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:12.672577 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3f916b05-10c2-4e3e-aa1e-2b70d20eab20 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:12.673046 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3f916b05-10c2-4e3e-aa1e-2b70d20eab20 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:12.805155 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3f916b05-10c2-4e3e-aa1e-2b70d20eab20 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:12.812382 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3f916b05-10c2-4e3e-aa1e-2b70d20eab20 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.151397 Nov 23 04:16:12.812945 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 174/307] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:12 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:12.828173 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3f818523-27e1-4e13-9f94-016b079d3350 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:12.828786 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3f818523-27e1-4e13-9f94-016b079d3350 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:12.834620 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3f818523-27e1-4e13-9f94-016b079d3350 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:12.835074 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3f818523-27e1-4e13-9f94-016b079d3350 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:12.835890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3f818523-27e1-4e13-9f94-016b079d3350 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:12.836327 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3f818523-27e1-4e13-9f94-016b079d3350 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:12.967290 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3f818523-27e1-4e13-9f94-016b079d3350 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:12.974408 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3f818523-27e1-4e13-9f94-016b079d3350 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.149649 Nov 23 04:16:12.974973 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 175/308] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:12 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:13.665415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-147d97d0-80fd-4c8e-ad57-1c4c711675e9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:13.666051 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-147d97d0-80fd-4c8e-ad57-1c4c711675e9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:13.672384 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-147d97d0-80fd-4c8e-ad57-1c4c711675e9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:13.672822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-147d97d0-80fd-4c8e-ad57-1c4c711675e9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:13.673600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-147d97d0-80fd-4c8e-ad57-1c4c711675e9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:13.674028 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-147d97d0-80fd-4c8e-ad57-1c4c711675e9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:13.802973 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-147d97d0-80fd-4c8e-ad57-1c4c711675e9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:13.810659 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-147d97d0-80fd-4c8e-ad57-1c4c711675e9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1501 microversion: 2.1 time: 0.149258 Nov 23 04:16:13.811239 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 176/309] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:13 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1501 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:13.826411 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e2e96d10-abf0-42fb-9035-29341eafee40 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:13.827007 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e2e96d10-abf0-42fb-9035-29341eafee40 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:13.832596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2e96d10-abf0-42fb-9035-29341eafee40 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:13.833047 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2e96d10-abf0-42fb-9035-29341eafee40 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:13.833823 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2e96d10-abf0-42fb-9035-29341eafee40 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:13.834255 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2e96d10-abf0-42fb-9035-29341eafee40 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:13.967479 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e2e96d10-abf0-42fb-9035-29341eafee40 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:13.974615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e2e96d10-abf0-42fb-9035-29341eafee40 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1514 microversion: 2.1 time: 0.151523 Nov 23 04:16:13.975166 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 177/310] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:13 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:13.979833 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9bb506fb-abc2-4dff-8888-5b82d8d03b4e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:13.980423 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9bb506fb-abc2-4dff-8888-5b82d8d03b4e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:13.985818 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9bb506fb-abc2-4dff-8888-5b82d8d03b4e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:13.986256 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9bb506fb-abc2-4dff-8888-5b82d8d03b4e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:13.987202 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9bb506fb-abc2-4dff-8888-5b82d8d03b4e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:13.987655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9bb506fb-abc2-4dff-8888-5b82d8d03b4e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:14.123262 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9bb506fb-abc2-4dff-8888-5b82d8d03b4e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:14.131433 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9bb506fb-abc2-4dff-8888-5b82d8d03b4e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.154238 Nov 23 04:16:14.131433 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 178/311] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:13 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:14.135180 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-eea55dfa-cbb4-4d4e-9239-d8d93da7ad24 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:14.135801 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-eea55dfa-cbb4-4d4e-9239-d8d93da7ad24 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:14.141593 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eea55dfa-cbb4-4d4e-9239-d8d93da7ad24 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:14.142035 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eea55dfa-cbb4-4d4e-9239-d8d93da7ad24 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:14.142804 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eea55dfa-cbb4-4d4e-9239-d8d93da7ad24 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:14.143252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eea55dfa-cbb4-4d4e-9239-d8d93da7ad24 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:14.273280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-eea55dfa-cbb4-4d4e-9239-d8d93da7ad24 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:14.280699 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-eea55dfa-cbb4-4d4e-9239-d8d93da7ad24 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.148825 Nov 23 04:16:14.281253 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 179/312] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:14 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:15.147934 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5b85e23b-646b-426b-9e77-79290d529ad0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:15.148583 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5b85e23b-646b-426b-9e77-79290d529ad0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:15.154787 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5b85e23b-646b-426b-9e77-79290d529ad0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:15.155238 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5b85e23b-646b-426b-9e77-79290d529ad0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:15.156018 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5b85e23b-646b-426b-9e77-79290d529ad0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:15.160373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5b85e23b-646b-426b-9e77-79290d529ad0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:15.295602 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5b85e23b-646b-426b-9e77-79290d529ad0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:15.299661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5f66feb8-c2cf-4762-a618-5541ae09eab5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 32733 microversion: 2.20 time: 2.650673 Nov 23 04:16:15.303750 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 134/313] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:12 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 32733 bytes in 2652 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:16:15.304827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5b85e23b-646b-426b-9e77-79290d529ad0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.160489 Nov 23 04:16:15.305472 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 180/314] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:15 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:15.306000 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-35b3253c-f356-4c20-8083-053ebedc2c5d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:15.307225 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-35b3253c-f356-4c20-8083-053ebedc2c5d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:15.314041 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-35b3253c-f356-4c20-8083-053ebedc2c5d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:15.314497 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-35b3253c-f356-4c20-8083-053ebedc2c5d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:15.315336 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-35b3253c-f356-4c20-8083-053ebedc2c5d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:15.315773 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-35b3253c-f356-4c20-8083-053ebedc2c5d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:15.449727 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-35b3253c-f356-4c20-8083-053ebedc2c5d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:15.458061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-35b3253c-f356-4c20-8083-053ebedc2c5d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.156536 Nov 23 04:16:15.458659 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 135/315] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:15 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:16.311940 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7a6e1959-b9e9-4b1c-95f3-c261df778a10 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:16.312924 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7a6e1959-b9e9-4b1c-95f3-c261df778a10 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:16.320173 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7a6e1959-b9e9-4b1c-95f3-c261df778a10 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:16.321320 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7a6e1959-b9e9-4b1c-95f3-c261df778a10 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:16.321474 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7a6e1959-b9e9-4b1c-95f3-c261df778a10 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:16.322291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7a6e1959-b9e9-4b1c-95f3-c261df778a10 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:16.323770 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6cfa97f5-bbdf-4f2a-9f01-7c6c869d99dc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:16.324555 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6cfa97f5-bbdf-4f2a-9f01-7c6c869d99dc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:16.330901 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6cfa97f5-bbdf-4f2a-9f01-7c6c869d99dc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:16.331394 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6cfa97f5-bbdf-4f2a-9f01-7c6c869d99dc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:16.332211 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6cfa97f5-bbdf-4f2a-9f01-7c6c869d99dc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:16.332650 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6cfa97f5-bbdf-4f2a-9f01-7c6c869d99dc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:16.442662 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7a6e1959-b9e9-4b1c-95f3-c261df778a10 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 33249 microversion: 2.20 time: 0.134449 Nov 23 04:16:16.443478 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 181/316] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:16 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 33249 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:16:16.475472 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6cfa97f5-bbdf-4f2a-9f01-7c6c869d99dc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:16.476459 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a616cc6c-75d8-4082-bca9-a8144a88ad8d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:16.477156 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a616cc6c-75d8-4082-bca9-a8144a88ad8d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:16.495826 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6cfa97f5-bbdf-4f2a-9f01-7c6c869d99dc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.166007 Nov 23 04:16:16.495955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a616cc6c-75d8-4082-bca9-a8144a88ad8d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:16.496037 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 136/317] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:16 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:16.496119 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a616cc6c-75d8-4082-bca9-a8144a88ad8d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:16.496119 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a616cc6c-75d8-4082-bca9-a8144a88ad8d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:16.496119 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a616cc6c-75d8-4082-bca9-a8144a88ad8d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:16.624159 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a616cc6c-75d8-4082-bca9-a8144a88ad8d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:16.631822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a616cc6c-75d8-4082-bca9-a8144a88ad8d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.160333 Nov 23 04:16:16.632390 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 182/318] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:16 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:16.798897 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-cc0f10b6-ce8b-41da-aca4-25dec20b1a94 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:16.799872 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-cc0f10b6-ce8b-41da-aca4-25dec20b1a94 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:16.806082 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc0f10b6-ce8b-41da-aca4-25dec20b1a94 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:16.806611 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc0f10b6-ce8b-41da-aca4-25dec20b1a94 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:16.807389 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc0f10b6-ce8b-41da-aca4-25dec20b1a94 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:16.807826 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc0f10b6-ce8b-41da-aca4-25dec20b1a94 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:16.830243 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-cc0f10b6-ce8b-41da-aca4-25dec20b1a94 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lazy-loading 'flavor' on Instance uuid 696e3da2-6fdb-4741-8f4f-fffccaf8d403 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:16:17.157038 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-cc0f10b6-ce8b-41da-aca4-25dec20b1a94 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/action" status: 200 len: 32 microversion: 2.1 time: 0.362869 Nov 23 04:16:17.157778 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 137/319] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:16:16 2021] POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:16:17.167132 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8b7e1710-1c8e-4c7e-a7a5-5130a32a7eb0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:17.167768 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8b7e1710-1c8e-4c7e-a7a5-5130a32a7eb0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:17.174449 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b7e1710-1c8e-4c7e-a7a5-5130a32a7eb0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:17.175090 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b7e1710-1c8e-4c7e-a7a5-5130a32a7eb0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:17.175849 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b7e1710-1c8e-4c7e-a7a5-5130a32a7eb0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:17.176280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b7e1710-1c8e-4c7e-a7a5-5130a32a7eb0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:17.312606 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8b7e1710-1c8e-4c7e-a7a5-5130a32a7eb0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:17.325855 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8b7e1710-1c8e-4c7e-a7a5-5130a32a7eb0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.160225 Nov 23 04:16:17.336005 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 183/320] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:17 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:17.455299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9f04b548-f5c7-46af-ac87-ce903a64d13f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:17.460422 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9f04b548-f5c7-46af-ac87-ce903a64d13f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:17.462592 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f04b548-f5c7-46af-ac87-ce903a64d13f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:17.463041 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f04b548-f5c7-46af-ac87-ce903a64d13f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:17.463860 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f04b548-f5c7-46af-ac87-ce903a64d13f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:17.464298 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f04b548-f5c7-46af-ac87-ce903a64d13f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:17.503172 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e6e08b11-0064-4665-a11c-d3bb7750e4e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:17.504147 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e6e08b11-0064-4665-a11c-d3bb7750e4e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:17.512028 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6e08b11-0064-4665-a11c-d3bb7750e4e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:17.512764 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6e08b11-0064-4665-a11c-d3bb7750e4e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:17.514028 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6e08b11-0064-4665-a11c-d3bb7750e4e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:17.514614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6e08b11-0064-4665-a11c-d3bb7750e4e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:17.676480 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e6e08b11-0064-4665-a11c-d3bb7750e4e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:17.684214 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e6e08b11-0064-4665-a11c-d3bb7750e4e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.184797 Nov 23 04:16:17.684772 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 184/321] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:17 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:17.688936 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1b8d00e3-d57f-418f-8260-e8475f7d537d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:17.689980 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1b8d00e3-d57f-418f-8260-e8475f7d537d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:17.695872 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1b8d00e3-d57f-418f-8260-e8475f7d537d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:17.696319 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1b8d00e3-d57f-418f-8260-e8475f7d537d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:17.697749 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1b8d00e3-d57f-418f-8260-e8475f7d537d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:17.698791 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1b8d00e3-d57f-418f-8260-e8475f7d537d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:17.846092 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1b8d00e3-d57f-418f-8260-e8475f7d537d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:17.857318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1b8d00e3-d57f-418f-8260-e8475f7d537d tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.171527 Nov 23 04:16:17.858714 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 185/322] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:17 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:18.343338 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-df13cb90-3d50-4a2d-b199-7a71e7b2382b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:18.344022 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-df13cb90-3d50-4a2d-b199-7a71e7b2382b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:18.350243 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-df13cb90-3d50-4a2d-b199-7a71e7b2382b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:18.350694 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-df13cb90-3d50-4a2d-b199-7a71e7b2382b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:18.351527 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-df13cb90-3d50-4a2d-b199-7a71e7b2382b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:18.351960 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-df13cb90-3d50-4a2d-b199-7a71e7b2382b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:18.512658 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-df13cb90-3d50-4a2d-b199-7a71e7b2382b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:18.520054 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-df13cb90-3d50-4a2d-b199-7a71e7b2382b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.180353 Nov 23 04:16:18.520555 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 186/323] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:18 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:18.700835 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fc61b617-8bbd-4dbb-8149-fdb95afaeeb2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:18.701442 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fc61b617-8bbd-4dbb-8149-fdb95afaeeb2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:18.707104 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc61b617-8bbd-4dbb-8149-fdb95afaeeb2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:18.712072 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc61b617-8bbd-4dbb-8149-fdb95afaeeb2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:18.712072 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc61b617-8bbd-4dbb-8149-fdb95afaeeb2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:18.712072 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc61b617-8bbd-4dbb-8149-fdb95afaeeb2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:18.842958 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-fc61b617-8bbd-4dbb-8149-fdb95afaeeb2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:18.850565 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fc61b617-8bbd-4dbb-8149-fdb95afaeeb2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.153471 Nov 23 04:16:18.851136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 187/324] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:18 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:18.873589 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6a0bdafc-8a24-47ce-9d66-4c1e2ce2b5b6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:18.874230 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6a0bdafc-8a24-47ce-9d66-4c1e2ce2b5b6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:18.880021 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6a0bdafc-8a24-47ce-9d66-4c1e2ce2b5b6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:18.880465 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6a0bdafc-8a24-47ce-9d66-4c1e2ce2b5b6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:18.881287 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6a0bdafc-8a24-47ce-9d66-4c1e2ce2b5b6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:18.881716 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6a0bdafc-8a24-47ce-9d66-4c1e2ce2b5b6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:19.024324 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6a0bdafc-8a24-47ce-9d66-4c1e2ce2b5b6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:19.052602 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6a0bdafc-8a24-47ce-9d66-4c1e2ce2b5b6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.182550 Nov 23 04:16:19.064169 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 188/325] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:18 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:19.536648 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-35c38a6f-9dcb-4af0-a12b-72a07df40d61 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:19.537275 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-35c38a6f-9dcb-4af0-a12b-72a07df40d61 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:19.545135 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-35c38a6f-9dcb-4af0-a12b-72a07df40d61 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:19.545584 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-35c38a6f-9dcb-4af0-a12b-72a07df40d61 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:19.546367 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-35c38a6f-9dcb-4af0-a12b-72a07df40d61 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:19.546794 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-35c38a6f-9dcb-4af0-a12b-72a07df40d61 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:19.687685 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-35c38a6f-9dcb-4af0-a12b-72a07df40d61 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:19.696831 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-35c38a6f-9dcb-4af0-a12b-72a07df40d61 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.163711 Nov 23 04:16:19.698818 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 189/326] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:19 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:19.704838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-f3765e94-1774-4bea-8b35-a80fa0873976 req-8f241655-8cff-4782-94cf-370a69bf42e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf175718-dca3-4da3-a676-f5d4d54f54e2", "name": "network-vif-plugged", "status": "completed", "tag": "c6aef10d-8d5c-41bc-b91c-795812fa4860"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:19.707022 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:16:19.707022 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:16:19.715071 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-f3765e94-1774-4bea-8b35-a80fa0873976 req-8f241655-8cff-4782-94cf-370a69bf42e9 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:19.715759 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-f3765e94-1774-4bea-8b35-a80fa0873976 req-8f241655-8cff-4782-94cf-370a69bf42e9 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:19.727117 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-f3765e94-1774-4bea-8b35-a80fa0873976 req-8f241655-8cff-4782-94cf-370a69bf42e9 service nova] Creating event network-vif-plugged:c6aef10d-8d5c-41bc-b91c-795812fa4860 for instance cf175718-dca3-4da3-a676-f5d4d54f54e2 on hv-cinder-76845 Nov 23 04:16:19.731885 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-f3765e94-1774-4bea-8b35-a80fa0873976 req-8f241655-8cff-4782-94cf-370a69bf42e9 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031699 Nov 23 04:16:19.732647 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 190/327] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:16:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:16:19.870229 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-380f5e99-ebd2-47c0-b44e-3969e0882837 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:19.870974 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-380f5e99-ebd2-47c0-b44e-3969e0882837 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:19.877344 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-380f5e99-ebd2-47c0-b44e-3969e0882837 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:19.877344 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-380f5e99-ebd2-47c0-b44e-3969e0882837 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:19.878058 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-380f5e99-ebd2-47c0-b44e-3969e0882837 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:19.878484 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-380f5e99-ebd2-47c0-b44e-3969e0882837 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:20.008293 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-380f5e99-ebd2-47c0-b44e-3969e0882837 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:20.015826 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-380f5e99-ebd2-47c0-b44e-3969e0882837 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.150187 Nov 23 04:16:20.016394 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 191/328] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:19 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:20.076546 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0a03fcec-5ca8-4b0e-b4a0-ce63952a7411 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:20.077158 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0a03fcec-5ca8-4b0e-b4a0-ce63952a7411 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:20.083121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0a03fcec-5ca8-4b0e-b4a0-ce63952a7411 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:20.083749 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0a03fcec-5ca8-4b0e-b4a0-ce63952a7411 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:20.084576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0a03fcec-5ca8-4b0e-b4a0-ce63952a7411 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:20.085018 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0a03fcec-5ca8-4b0e-b4a0-ce63952a7411 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:20.218195 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0a03fcec-5ca8-4b0e-b4a0-ce63952a7411 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:20.225376 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0a03fcec-5ca8-4b0e-b4a0-ce63952a7411 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.153504 Nov 23 04:16:20.225939 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 192/329] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:20 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:20.522254 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9f04b548-f5c7-46af-ac87-ce903a64d13f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 36120 microversion: 2.20 time: 3.071396 Nov 23 04:16:20.522938 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 138/330] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:17 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 36120 bytes in 3073 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:16:20.715848 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4127b6b9-2421-4745-91bd-ca92f502cebc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:20.716498 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4127b6b9-2421-4745-91bd-ca92f502cebc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:20.723022 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4127b6b9-2421-4745-91bd-ca92f502cebc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:20.723498 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4127b6b9-2421-4745-91bd-ca92f502cebc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:20.724279 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4127b6b9-2421-4745-91bd-ca92f502cebc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:20.724743 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4127b6b9-2421-4745-91bd-ca92f502cebc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:20.916127 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4127b6b9-2421-4745-91bd-ca92f502cebc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:20.924159 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4127b6b9-2421-4745-91bd-ca92f502cebc tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.212791 Nov 23 04:16:20.924948 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 193/331] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:20 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:21.033522 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4ee45f30-65c6-4d55-83a3-181cb6b2d54d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:21.034254 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4ee45f30-65c6-4d55-83a3-181cb6b2d54d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:21.041909 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ee45f30-65c6-4d55-83a3-181cb6b2d54d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:21.042359 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ee45f30-65c6-4d55-83a3-181cb6b2d54d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:21.043141 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ee45f30-65c6-4d55-83a3-181cb6b2d54d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:21.043601 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ee45f30-65c6-4d55-83a3-181cb6b2d54d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:21.189280 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4ee45f30-65c6-4d55-83a3-181cb6b2d54d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:21.196756 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4ee45f30-65c6-4d55-83a3-181cb6b2d54d tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.167205 Nov 23 04:16:21.197396 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 139/332] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:21 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:21.242116 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-889efd00-1d5b-45d1-a2f8-e2cdf47b4d73 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:21.242760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-889efd00-1d5b-45d1-a2f8-e2cdf47b4d73 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:21.250182 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-889efd00-1d5b-45d1-a2f8-e2cdf47b4d73 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:21.252136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-889efd00-1d5b-45d1-a2f8-e2cdf47b4d73 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:21.252136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-889efd00-1d5b-45d1-a2f8-e2cdf47b4d73 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:21.252429 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-889efd00-1d5b-45d1-a2f8-e2cdf47b4d73 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:21.388972 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-889efd00-1d5b-45d1-a2f8-e2cdf47b4d73 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:21.396118 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-889efd00-1d5b-45d1-a2f8-e2cdf47b4d73 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.157695 Nov 23 04:16:21.396980 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 194/333] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:21 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:21.535268 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c212995f-c9b5-4477-8f84-42bd4f534336 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:21.536178 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c212995f-c9b5-4477-8f84-42bd4f534336 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:21.543914 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c212995f-c9b5-4477-8f84-42bd4f534336 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:21.544372 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c212995f-c9b5-4477-8f84-42bd4f534336 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:21.545159 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c212995f-c9b5-4477-8f84-42bd4f534336 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:21.545604 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c212995f-c9b5-4477-8f84-42bd4f534336 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:21.660996 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c212995f-c9b5-4477-8f84-42bd4f534336 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 36606 microversion: 2.20 time: 0.129253 Nov 23 04:16:21.662413 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 140/334] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:21 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 36606 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:16:21.943049 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8cbc44f7-d078-460e-b22a-ec10c6576a70 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:21.943678 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8cbc44f7-d078-460e-b22a-ec10c6576a70 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:21.950512 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8cbc44f7-d078-460e-b22a-ec10c6576a70 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:21.950950 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8cbc44f7-d078-460e-b22a-ec10c6576a70 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:21.951750 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8cbc44f7-d078-460e-b22a-ec10c6576a70 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:21.952179 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8cbc44f7-d078-460e-b22a-ec10c6576a70 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:22.084314 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8cbc44f7-d078-460e-b22a-ec10c6576a70 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:22.091718 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8cbc44f7-d078-460e-b22a-ec10c6576a70 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.152436 Nov 23 04:16:22.092345 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 195/335] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:21 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:22.214229 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-162e1347-7df9-409a-afe0-8cb1c62f0b7e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:22.214927 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-162e1347-7df9-409a-afe0-8cb1c62f0b7e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:22.221687 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-162e1347-7df9-409a-afe0-8cb1c62f0b7e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:22.222215 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-162e1347-7df9-409a-afe0-8cb1c62f0b7e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:22.222936 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-162e1347-7df9-409a-afe0-8cb1c62f0b7e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:22.223417 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-162e1347-7df9-409a-afe0-8cb1c62f0b7e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:22.363678 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-162e1347-7df9-409a-afe0-8cb1c62f0b7e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:22.371622 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-162e1347-7df9-409a-afe0-8cb1c62f0b7e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1317 microversion: 2.1 time: 0.161371 Nov 23 04:16:22.372330 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 141/336] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:22 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:22.413924 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-229dfcc3-80aa-4e49-8558-6b337880ec18 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:22.415022 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-229dfcc3-80aa-4e49-8558-6b337880ec18 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:22.421880 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-229dfcc3-80aa-4e49-8558-6b337880ec18 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:22.422321 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-229dfcc3-80aa-4e49-8558-6b337880ec18 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:22.423088 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-229dfcc3-80aa-4e49-8558-6b337880ec18 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:22.423548 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-229dfcc3-80aa-4e49-8558-6b337880ec18 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:22.567577 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-229dfcc3-80aa-4e49-8558-6b337880ec18 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:22.575370 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-229dfcc3-80aa-4e49-8558-6b337880ec18 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.165120 Nov 23 04:16:22.575951 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 196/337] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:22 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:22.678168 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4ae54693-e252-4e30-99c4-1958b04925c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:22.680068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4ae54693-e252-4e30-99c4-1958b04925c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:22.692451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ae54693-e252-4e30-99c4-1958b04925c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:22.693122 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ae54693-e252-4e30-99c4-1958b04925c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:22.694089 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ae54693-e252-4e30-99c4-1958b04925c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:22.694804 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ae54693-e252-4e30-99c4-1958b04925c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:22.824498 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4ae54693-e252-4e30-99c4-1958b04925c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 37237 microversion: 2.20 time: 0.154707 Nov 23 04:16:22.825195 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 142/338] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:22 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 37237 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:16:22.943379 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-0064b65b-b095-40d1-9692-02042d81a4d8 req-77e8b03e-af59-4b3f-9e99-19f5e09021cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da592d1-d534-4643-8e5f-35edefd614b4", "name": "network-vif-plugged", "status": "completed", "tag": "2c6f1671-b600-4d12-99a6-94d877dbbfeb"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:22.945054 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:16:22.945054 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:16:22.952593 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-0064b65b-b095-40d1-9692-02042d81a4d8 req-77e8b03e-af59-4b3f-9e99-19f5e09021cc service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:22.953027 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-0064b65b-b095-40d1-9692-02042d81a4d8 req-77e8b03e-af59-4b3f-9e99-19f5e09021cc service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:22.964978 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-0064b65b-b095-40d1-9692-02042d81a4d8 req-77e8b03e-af59-4b3f-9e99-19f5e09021cc service nova] Creating event network-vif-plugged:2c6f1671-b600-4d12-99a6-94d877dbbfeb for instance 9da592d1-d534-4643-8e5f-35edefd614b4 on hv-cinder-76845 Nov 23 04:16:22.970000 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-0064b65b-b095-40d1-9692-02042d81a4d8 req-77e8b03e-af59-4b3f-9e99-19f5e09021cc service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030308 Nov 23 04:16:22.972648 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 197/339] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:16:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:16:23.108933 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-71578473-808c-414e-be53-08f2de66fbde tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:23.109653 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-71578473-808c-414e-be53-08f2de66fbde tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:23.117672 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-71578473-808c-414e-be53-08f2de66fbde tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:23.119166 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-71578473-808c-414e-be53-08f2de66fbde tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:23.120317 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-71578473-808c-414e-be53-08f2de66fbde tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:23.121398 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-71578473-808c-414e-be53-08f2de66fbde tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:23.305680 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-71578473-808c-414e-be53-08f2de66fbde tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:23.313761 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-71578473-808c-414e-be53-08f2de66fbde tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.208757 Nov 23 04:16:23.321322 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 143/340] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:23 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:23.389329 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fdc0ed16-f889-44b8-a569-0e8b0c79c628 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:23.390020 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fdc0ed16-f889-44b8-a569-0e8b0c79c628 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:23.397161 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fdc0ed16-f889-44b8-a569-0e8b0c79c628 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:23.397653 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fdc0ed16-f889-44b8-a569-0e8b0c79c628 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:23.398470 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fdc0ed16-f889-44b8-a569-0e8b0c79c628 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:23.398895 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fdc0ed16-f889-44b8-a569-0e8b0c79c628 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:23.536286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-fdc0ed16-f889-44b8-a569-0e8b0c79c628 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:23.544535 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fdc0ed16-f889-44b8-a569-0e8b0c79c628 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1506 microversion: 2.1 time: 0.159515 Nov 23 04:16:23.545092 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 198/341] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:23 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:23.592954 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2fd3a20c-6fac-46b9-becc-681d0bed62dc tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:23.593567 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2fd3a20c-6fac-46b9-becc-681d0bed62dc tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:23.599817 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2fd3a20c-6fac-46b9-becc-681d0bed62dc tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:23.600298 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2fd3a20c-6fac-46b9-becc-681d0bed62dc tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:23.601121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2fd3a20c-6fac-46b9-becc-681d0bed62dc tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:23.601553 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2fd3a20c-6fac-46b9-becc-681d0bed62dc tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:23.736748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2fd3a20c-6fac-46b9-becc-681d0bed62dc tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:23.744103 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2fd3a20c-6fac-46b9-becc-681d0bed62dc tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.154579 Nov 23 04:16:23.744673 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 144/342] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:23 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:23.836845 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5930d374-1fb8-4ec2-842d-43da2d726a89 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:23.838581 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5930d374-1fb8-4ec2-842d-43da2d726a89 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:23.844377 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5930d374-1fb8-4ec2-842d-43da2d726a89 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:23.844818 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5930d374-1fb8-4ec2-842d-43da2d726a89 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:23.845582 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5930d374-1fb8-4ec2-842d-43da2d726a89 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:23.846011 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5930d374-1fb8-4ec2-842d-43da2d726a89 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:24.331914 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-401f841c-5c09-4a0d-8bf5-3b5de2b61752 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:24.332535 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-401f841c-5c09-4a0d-8bf5-3b5de2b61752 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:24.339341 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-401f841c-5c09-4a0d-8bf5-3b5de2b61752 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:24.339794 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-401f841c-5c09-4a0d-8bf5-3b5de2b61752 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:24.340610 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-401f841c-5c09-4a0d-8bf5-3b5de2b61752 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:24.341068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-401f841c-5c09-4a0d-8bf5-3b5de2b61752 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:24.477702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-401f841c-5c09-4a0d-8bf5-3b5de2b61752 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:24.482856 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-401f841c-5c09-4a0d-8bf5-3b5de2b61752 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.154759 Nov 23 04:16:24.483458 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 145/343] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:24 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:24.761616 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9c1c3ed8-9f43-4b80-ad4f-e7dd20639909 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:24.762225 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9c1c3ed8-9f43-4b80-ad4f-e7dd20639909 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:24.768050 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9c1c3ed8-9f43-4b80-ad4f-e7dd20639909 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:24.768504 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9c1c3ed8-9f43-4b80-ad4f-e7dd20639909 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:24.769271 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9c1c3ed8-9f43-4b80-ad4f-e7dd20639909 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:24.769704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9c1c3ed8-9f43-4b80-ad4f-e7dd20639909 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:24.898527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9c1c3ed8-9f43-4b80-ad4f-e7dd20639909 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:24.905950 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9c1c3ed8-9f43-4b80-ad4f-e7dd20639909 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.148597 Nov 23 04:16:24.906515 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 146/344] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:24 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:25.500551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d9322083-b655-4d3e-a644-9167119f3c10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:25.501242 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d9322083-b655-4d3e-a644-9167119f3c10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:25.507150 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9322083-b655-4d3e-a644-9167119f3c10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:25.507625 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9322083-b655-4d3e-a644-9167119f3c10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:25.508409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9322083-b655-4d3e-a644-9167119f3c10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:25.508869 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9322083-b655-4d3e-a644-9167119f3c10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:25.640354 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d9322083-b655-4d3e-a644-9167119f3c10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:25.647612 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d9322083-b655-4d3e-a644-9167119f3c10 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.150756 Nov 23 04:16:25.648177 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 147/345] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:25 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:25.923541 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-941ce173-f971-4b53-b523-be4064b4372f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:25.924152 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-941ce173-f971-4b53-b523-be4064b4372f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:25.930237 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-941ce173-f971-4b53-b523-be4064b4372f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:25.930681 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-941ce173-f971-4b53-b523-be4064b4372f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:25.931530 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-941ce173-f971-4b53-b523-be4064b4372f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:25.931965 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-941ce173-f971-4b53-b523-be4064b4372f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:26.059944 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-941ce173-f971-4b53-b523-be4064b4372f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:26.067073 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-941ce173-f971-4b53-b523-be4064b4372f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.147128 Nov 23 04:16:26.067658 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 148/346] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:25 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:26.461570 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5930d374-1fb8-4ec2-842d-43da2d726a89 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 38148 microversion: 2.20 time: 2.628540 Nov 23 04:16:26.462229 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 199/347] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:23 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 38148 bytes in 2630 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:16:26.665335 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9b35735f-cd17-429b-8275-78fcc0472f29 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:26.666054 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9b35735f-cd17-429b-8275-78fcc0472f29 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:26.672058 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b35735f-cd17-429b-8275-78fcc0472f29 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:26.672523 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b35735f-cd17-429b-8275-78fcc0472f29 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:26.673301 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b35735f-cd17-429b-8275-78fcc0472f29 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:26.673729 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b35735f-cd17-429b-8275-78fcc0472f29 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:26.804731 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9b35735f-cd17-429b-8275-78fcc0472f29 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:26.812985 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9b35735f-cd17-429b-8275-78fcc0472f29 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.151792 Nov 23 04:16:26.813585 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 149/348] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:26 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:27.083790 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c877f26b-4dd1-4355-8a85-d8f6de4a9f59 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:27.084507 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c877f26b-4dd1-4355-8a85-d8f6de4a9f59 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:27.092152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c877f26b-4dd1-4355-8a85-d8f6de4a9f59 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:27.092604 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c877f26b-4dd1-4355-8a85-d8f6de4a9f59 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:27.093395 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c877f26b-4dd1-4355-8a85-d8f6de4a9f59 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:27.093823 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c877f26b-4dd1-4355-8a85-d8f6de4a9f59 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:27.232579 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c877f26b-4dd1-4355-8a85-d8f6de4a9f59 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:27.239987 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c877f26b-4dd1-4355-8a85-d8f6de4a9f59 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.160148 Nov 23 04:16:27.240546 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 200/349] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:27 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:27.473788 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2401f7ec-40fb-45fd-82f2-0600bbdbf60a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:27.474880 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2401f7ec-40fb-45fd-82f2-0600bbdbf60a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:27.481752 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2401f7ec-40fb-45fd-82f2-0600bbdbf60a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:27.495665 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2401f7ec-40fb-45fd-82f2-0600bbdbf60a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:27.495665 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2401f7ec-40fb-45fd-82f2-0600bbdbf60a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:27.495665 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2401f7ec-40fb-45fd-82f2-0600bbdbf60a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:27.829542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3e24647e-659b-429d-b8a8-44c4588a32f4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:27.830148 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3e24647e-659b-429d-b8a8-44c4588a32f4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:27.836575 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e24647e-659b-429d-b8a8-44c4588a32f4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:27.837018 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e24647e-659b-429d-b8a8-44c4588a32f4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:27.838292 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e24647e-659b-429d-b8a8-44c4588a32f4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:27.838716 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e24647e-659b-429d-b8a8-44c4588a32f4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:28.105083 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3e24647e-659b-429d-b8a8-44c4588a32f4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:28.112665 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3e24647e-659b-429d-b8a8-44c4588a32f4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.286637 Nov 23 04:16:28.113206 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 201/350] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:27 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:28.257471 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1eb21386-1930-4fa5-b570-f0adecf3b2f6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:28.258069 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1eb21386-1930-4fa5-b570-f0adecf3b2f6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:28.264603 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1eb21386-1930-4fa5-b570-f0adecf3b2f6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:28.265073 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1eb21386-1930-4fa5-b570-f0adecf3b2f6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:28.265854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1eb21386-1930-4fa5-b570-f0adecf3b2f6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:28.266287 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1eb21386-1930-4fa5-b570-f0adecf3b2f6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:28.400358 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1eb21386-1930-4fa5-b570-f0adecf3b2f6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:28.407834 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1eb21386-1930-4fa5-b570-f0adecf3b2f6 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.154020 Nov 23 04:16:28.408391 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 202/351] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:28 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:29.129757 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8a369427-0fc5-4f10-9a58-14923a6573cd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:29.130408 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8a369427-0fc5-4f10-9a58-14923a6573cd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:29.137539 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a369427-0fc5-4f10-9a58-14923a6573cd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:29.137992 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a369427-0fc5-4f10-9a58-14923a6573cd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:29.138770 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a369427-0fc5-4f10-9a58-14923a6573cd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:29.139204 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a369427-0fc5-4f10-9a58-14923a6573cd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:29.267934 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8a369427-0fc5-4f10-9a58-14923a6573cd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:29.275630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8a369427-0fc5-4f10-9a58-14923a6573cd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.148879 Nov 23 04:16:29.276183 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 203/352] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:29 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:29.424971 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a4f0c28c-5389-4de5-b6eb-52de2586a077 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:29.425686 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a4f0c28c-5389-4de5-b6eb-52de2586a077 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:29.432135 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4f0c28c-5389-4de5-b6eb-52de2586a077 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:29.432541 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4f0c28c-5389-4de5-b6eb-52de2586a077 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:29.433318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4f0c28c-5389-4de5-b6eb-52de2586a077 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:29.433855 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4f0c28c-5389-4de5-b6eb-52de2586a077 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:29.568876 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a4f0c28c-5389-4de5-b6eb-52de2586a077 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:29.576882 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a4f0c28c-5389-4de5-b6eb-52de2586a077 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.155504 Nov 23 04:16:29.577433 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 204/353] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:29 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:29.994441 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2401f7ec-40fb-45fd-82f2-0600bbdbf60a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 200 len: 38289 microversion: 2.20 time: 2.523151 Nov 23 04:16:29.995199 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 150/354] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:27 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 38289 bytes in 2526 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:16:30.005087 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dda396d0-ed23-4e5d-afb8-d6e243aba3f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:30.005574 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dda396d0-ed23-4e5d-afb8-d6e243aba3f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:30.011456 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dda396d0-ed23-4e5d-afb8-d6e243aba3f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:30.011897 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dda396d0-ed23-4e5d-afb8-d6e243aba3f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:30.012668 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dda396d0-ed23-4e5d-afb8-d6e243aba3f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:30.013097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dda396d0-ed23-4e5d-afb8-d6e243aba3f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:30.035036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dda396d0-ed23-4e5d-afb8-d6e243aba3f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/ips" status: 200 len: 151 microversion: 2.20 time: 0.033678 Nov 23 04:16:30.035603 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 205/355] 10.222.0.54 () {60 vars in 1288 bytes} [Tue Nov 23 04:16:30 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/ips => generated 151 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:16:30.294342 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e45af752-bab4-47d2-a38a-c607801dc2b0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:30.295051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e45af752-bab4-47d2-a38a-c607801dc2b0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:30.302011 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e45af752-bab4-47d2-a38a-c607801dc2b0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:30.302457 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e45af752-bab4-47d2-a38a-c607801dc2b0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:30.303232 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e45af752-bab4-47d2-a38a-c607801dc2b0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:30.303679 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e45af752-bab4-47d2-a38a-c607801dc2b0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:30.435548 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e45af752-bab4-47d2-a38a-c607801dc2b0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:30.443655 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e45af752-bab4-47d2-a38a-c607801dc2b0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.154418 Nov 23 04:16:30.444217 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 151/356] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:30 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:30.594149 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-27b97091-55da-410d-935b-86fdef439b3a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:30.594760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-27b97091-55da-410d-935b-86fdef439b3a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:30.601371 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27b97091-55da-410d-935b-86fdef439b3a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:30.601821 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27b97091-55da-410d-935b-86fdef439b3a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:30.602609 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27b97091-55da-410d-935b-86fdef439b3a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:30.603247 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27b97091-55da-410d-935b-86fdef439b3a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:30.760890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-27b97091-55da-410d-935b-86fdef439b3a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:30.768308 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-27b97091-55da-410d-935b-86fdef439b3a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.177764 Nov 23 04:16:30.769169 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 206/357] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:30 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:31.461012 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-abbd04a6-9103-4d5f-804b-7cfb5154a812 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:31.461526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-abbd04a6-9103-4d5f-804b-7cfb5154a812 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:31.468500 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-abbd04a6-9103-4d5f-804b-7cfb5154a812 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:31.468937 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-abbd04a6-9103-4d5f-804b-7cfb5154a812 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:31.469705 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-abbd04a6-9103-4d5f-804b-7cfb5154a812 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:31.470137 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-abbd04a6-9103-4d5f-804b-7cfb5154a812 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:31.600591 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-abbd04a6-9103-4d5f-804b-7cfb5154a812 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:31.607936 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-abbd04a6-9103-4d5f-804b-7cfb5154a812 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.150654 Nov 23 04:16:31.608496 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 152/358] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:31 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:31.785452 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-abfd5eb0-1f66-4e21-9a67-1a476c64a224 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:31.786075 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-abfd5eb0-1f66-4e21-9a67-1a476c64a224 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:31.792858 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-abfd5eb0-1f66-4e21-9a67-1a476c64a224 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:31.793310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-abfd5eb0-1f66-4e21-9a67-1a476c64a224 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:31.794103 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-abfd5eb0-1f66-4e21-9a67-1a476c64a224 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:31.794543 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-abfd5eb0-1f66-4e21-9a67-1a476c64a224 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:31.924564 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-abfd5eb0-1f66-4e21-9a67-1a476c64a224 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:31.932345 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-abfd5eb0-1f66-4e21-9a67-1a476c64a224 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.150599 Nov 23 04:16:31.932899 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 207/359] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:31 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:32.625009 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-114642e0-5416-40d0-88cb-cd0b48ab2649 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:32.625614 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-114642e0-5416-40d0-88cb-cd0b48ab2649 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:32.631866 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-114642e0-5416-40d0-88cb-cd0b48ab2649 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:32.632315 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-114642e0-5416-40d0-88cb-cd0b48ab2649 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:32.633088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-114642e0-5416-40d0-88cb-cd0b48ab2649 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:32.633524 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-114642e0-5416-40d0-88cb-cd0b48ab2649 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:32.765269 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-114642e0-5416-40d0-88cb-cd0b48ab2649 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:32.772363 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-114642e0-5416-40d0-88cb-cd0b48ab2649 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.150981 Nov 23 04:16:32.772915 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 153/360] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:32 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:32.948529 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e816ea48-51c2-4ecb-9fac-0490f2f05567 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:32.949142 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e816ea48-51c2-4ecb-9fac-0490f2f05567 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:32.955498 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e816ea48-51c2-4ecb-9fac-0490f2f05567 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:32.955952 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e816ea48-51c2-4ecb-9fac-0490f2f05567 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:32.956734 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e816ea48-51c2-4ecb-9fac-0490f2f05567 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:32.957168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e816ea48-51c2-4ecb-9fac-0490f2f05567 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:33.086312 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e816ea48-51c2-4ecb-9fac-0490f2f05567 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:33.094240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e816ea48-51c2-4ecb-9fac-0490f2f05567 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.149982 Nov 23 04:16:33.094792 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 208/361] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:32 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:33.789600 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7fa4c91b-eb60-4fd8-8b88-86bbfb6f89eb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:33.790189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7fa4c91b-eb60-4fd8-8b88-86bbfb6f89eb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:33.796648 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7fa4c91b-eb60-4fd8-8b88-86bbfb6f89eb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:33.797109 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7fa4c91b-eb60-4fd8-8b88-86bbfb6f89eb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:33.797957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7fa4c91b-eb60-4fd8-8b88-86bbfb6f89eb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:33.798394 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7fa4c91b-eb60-4fd8-8b88-86bbfb6f89eb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:34.087323 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7fa4c91b-eb60-4fd8-8b88-86bbfb6f89eb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:34.094728 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7fa4c91b-eb60-4fd8-8b88-86bbfb6f89eb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.309239 Nov 23 04:16:34.095315 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 154/362] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:33 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:34.111389 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-39478301-be5f-4ea5-93ce-1cc041851393 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:34.113345 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-39478301-be5f-4ea5-93ce-1cc041851393 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:34.118705 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-39478301-be5f-4ea5-93ce-1cc041851393 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:34.119153 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-39478301-be5f-4ea5-93ce-1cc041851393 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:34.119965 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-39478301-be5f-4ea5-93ce-1cc041851393 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:34.120405 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-39478301-be5f-4ea5-93ce-1cc041851393 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:34.251734 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-39478301-be5f-4ea5-93ce-1cc041851393 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:34.258923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-39478301-be5f-4ea5-93ce-1cc041851393 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1315 microversion: 2.1 time: 0.151294 Nov 23 04:16:34.259519 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 209/363] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:34 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:34.562478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0e101761-df65-41a1-bbbe-5fa0c5a6efed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c236ad20-0310-4d97-836a-b8d02184cd67"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:34.563606 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0e101761-df65-41a1-bbbe-5fa0c5a6efed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:34.569255 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e101761-df65-41a1-bbbe-5fa0c5a6efed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:34.569701 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e101761-df65-41a1-bbbe-5fa0c5a6efed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:34.570478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e101761-df65-41a1-bbbe-5fa0c5a6efed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:34.570907 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e101761-df65-41a1-bbbe-5fa0c5a6efed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:35.111521 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4f8f8b59-5117-4fac-83cb-4c5468965f58 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:35.112250 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4f8f8b59-5117-4fac-83cb-4c5468965f58 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:35.117962 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f8f8b59-5117-4fac-83cb-4c5468965f58 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:35.118485 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f8f8b59-5117-4fac-83cb-4c5468965f58 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:35.119338 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f8f8b59-5117-4fac-83cb-4c5468965f58 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:35.119771 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f8f8b59-5117-4fac-83cb-4c5468965f58 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:35.259128 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4f8f8b59-5117-4fac-83cb-4c5468965f58 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:35.281032 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4f8f8b59-5117-4fac-83cb-4c5468965f58 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.173038 Nov 23 04:16:35.293557 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 210/364] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:35 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:35.304559 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2eb11836-2ae8-4e58-9a04-1903a5d75a1f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:35.305309 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2eb11836-2ae8-4e58-9a04-1903a5d75a1f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:35.311951 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2eb11836-2ae8-4e58-9a04-1903a5d75a1f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:35.312535 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2eb11836-2ae8-4e58-9a04-1903a5d75a1f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:35.313699 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2eb11836-2ae8-4e58-9a04-1903a5d75a1f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:35.314269 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2eb11836-2ae8-4e58-9a04-1903a5d75a1f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:35.456487 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2eb11836-2ae8-4e58-9a04-1903a5d75a1f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:35.466931 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2eb11836-2ae8-4e58-9a04-1903a5d75a1f tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1465 microversion: 2.1 time: 0.172307 Nov 23 04:16:35.467575 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 211/365] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:35 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1465 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:35.492930 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0e101761-df65-41a1-bbbe-5fa0c5a6efed tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "POST /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.934034 Nov 23 04:16:35.494942 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 155/366] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:16:34 2021] POST /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:16:35.507723 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1a32a4ce-ab1b-43dd-a486-56cbc8a4ea4b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:35.510529 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1a32a4ce-ab1b-43dd-a486-56cbc8a4ea4b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:35.519364 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a32a4ce-ab1b-43dd-a486-56cbc8a4ea4b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:35.519996 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a32a4ce-ab1b-43dd-a486-56cbc8a4ea4b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:35.523915 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a32a4ce-ab1b-43dd-a486-56cbc8a4ea4b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:35.523915 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a32a4ce-ab1b-43dd-a486-56cbc8a4ea4b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:35.550527 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1a32a4ce-ab1b-43dd-a486-56cbc8a4ea4b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:16:35.929085 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1a32a4ce-ab1b-43dd-a486-56cbc8a4ea4b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "DELETE /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 204 len: 0 microversion: 2.1 time: 0.425826 Nov 23 04:16:35.929860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 212/367] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:16:35 2021] DELETE /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:16:35.939109 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8e73f0d8-d41f-40bb-97cb-f7d99dbd73cd tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:35.939843 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8e73f0d8-d41f-40bb-97cb-f7d99dbd73cd tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:35.947070 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8e73f0d8-d41f-40bb-97cb-f7d99dbd73cd tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:35.947643 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8e73f0d8-d41f-40bb-97cb-f7d99dbd73cd tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:35.948433 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8e73f0d8-d41f-40bb-97cb-f7d99dbd73cd tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:35.948887 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8e73f0d8-d41f-40bb-97cb-f7d99dbd73cd tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:36.132051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8e73f0d8-d41f-40bb-97cb-f7d99dbd73cd tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:36.140061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8e73f0d8-d41f-40bb-97cb-f7d99dbd73cd tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1471 microversion: 2.1 time: 0.205500 Nov 23 04:16:36.140648 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 156/368] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:35 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:36.314516 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e273068d-9e51-4064-920d-7c35e2d34af3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:36.315244 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e273068d-9e51-4064-920d-7c35e2d34af3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:36.321973 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e273068d-9e51-4064-920d-7c35e2d34af3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:36.323139 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e273068d-9e51-4064-920d-7c35e2d34af3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:36.323600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e273068d-9e51-4064-920d-7c35e2d34af3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:36.323765 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e273068d-9e51-4064-920d-7c35e2d34af3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:36.451316 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c356a28d-b28f-4d9d-b279-00fa35a24444 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:36.452132 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c356a28d-b28f-4d9d-b279-00fa35a24444 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:36.457930 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c356a28d-b28f-4d9d-b279-00fa35a24444 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:36.458458 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c356a28d-b28f-4d9d-b279-00fa35a24444 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:36.459264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c356a28d-b28f-4d9d-b279-00fa35a24444 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:36.459704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c356a28d-b28f-4d9d-b279-00fa35a24444 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:36.471193 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e273068d-9e51-4064-920d-7c35e2d34af3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:36.479943 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e273068d-9e51-4064-920d-7c35e2d34af3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.169480 Nov 23 04:16:36.480446 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 213/369] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:36 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:36.484225 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-c356a28d-b28f-4d9d-b279-00fa35a24444 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lazy-loading 'flavor' on Instance uuid 8c13d4db-587d-4d4e-b8cc-23632d768572 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:16:37.110514 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c356a28d-b28f-4d9d-b279-00fa35a24444 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 202 len: 0 microversion: 2.20 time: 0.663657 Nov 23 04:16:37.112062 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 157/370] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:16:36 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 23 04:16:37.121364 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-514b4ba2-a9d9-416b-8148-cc97cf5600cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:37.122363 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-514b4ba2-a9d9-416b-8148-cc97cf5600cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:37.129219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-514b4ba2-a9d9-416b-8148-cc97cf5600cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:37.133983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-514b4ba2-a9d9-416b-8148-cc97cf5600cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:37.133983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-514b4ba2-a9d9-416b-8148-cc97cf5600cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:37.133983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-514b4ba2-a9d9-416b-8148-cc97cf5600cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:37.160206 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ecfb60a7-8c22-4d19-92bf-5126adef0635 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:37.161188 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ecfb60a7-8c22-4d19-92bf-5126adef0635 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:37.168605 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ecfb60a7-8c22-4d19-92bf-5126adef0635 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:37.169258 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ecfb60a7-8c22-4d19-92bf-5126adef0635 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:37.179529 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ecfb60a7-8c22-4d19-92bf-5126adef0635 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:37.180013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ecfb60a7-8c22-4d19-92bf-5126adef0635 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:37.323800 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-514b4ba2-a9d9-416b-8148-cc97cf5600cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:37.332512 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-514b4ba2-a9d9-416b-8148-cc97cf5600cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:37.334027 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-514b4ba2-a9d9-416b-8148-cc97cf5600cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:37.335161 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-514b4ba2-a9d9-416b-8148-cc97cf5600cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.218310 Nov 23 04:16:37.335744 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 214/371] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:37 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:16:37.373256 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ecfb60a7-8c22-4d19-92bf-5126adef0635 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:37.380779 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ecfb60a7-8c22-4d19-92bf-5126adef0635 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1471 microversion: 2.1 time: 0.224787 Nov 23 04:16:37.381347 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 158/372] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:37 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:37.498072 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-778cbb40-a844-496a-8fdd-bda39bd68abf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:37.498926 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-778cbb40-a844-496a-8fdd-bda39bd68abf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:37.512276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-778cbb40-a844-496a-8fdd-bda39bd68abf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:37.512276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-778cbb40-a844-496a-8fdd-bda39bd68abf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:37.512276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-778cbb40-a844-496a-8fdd-bda39bd68abf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:37.512276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-778cbb40-a844-496a-8fdd-bda39bd68abf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:37.666320 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-778cbb40-a844-496a-8fdd-bda39bd68abf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:37.673686 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-778cbb40-a844-496a-8fdd-bda39bd68abf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.180501 Nov 23 04:16:37.674731 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 215/373] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:37 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:38.353898 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-af790771-dd79-446f-b0a0-2fc6ad50de19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:38.354552 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-af790771-dd79-446f-b0a0-2fc6ad50de19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:38.361445 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af790771-dd79-446f-b0a0-2fc6ad50de19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:38.362053 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af790771-dd79-446f-b0a0-2fc6ad50de19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:38.363264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af790771-dd79-446f-b0a0-2fc6ad50de19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:38.364028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-af790771-dd79-446f-b0a0-2fc6ad50de19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:38.406768 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b75d2e8b-88cd-4aa5-a84f-fb817c54b61a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:38.408274 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b75d2e8b-88cd-4aa5-a84f-fb817c54b61a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:38.416077 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b75d2e8b-88cd-4aa5-a84f-fb817c54b61a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:38.418109 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b75d2e8b-88cd-4aa5-a84f-fb817c54b61a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:38.418109 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b75d2e8b-88cd-4aa5-a84f-fb817c54b61a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:38.418865 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b75d2e8b-88cd-4aa5-a84f-fb817c54b61a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:38.702234 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-af790771-dd79-446f-b0a0-2fc6ad50de19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:38.706918 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b75d2e8b-88cd-4aa5-a84f-fb817c54b61a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:38.714673 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-af790771-dd79-446f-b0a0-2fc6ad50de19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:38.715291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b75d2e8b-88cd-4aa5-a84f-fb817c54b61a tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1471 microversion: 2.1 time: 0.317086 Nov 23 04:16:38.716373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 216/374] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:38 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1471 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:38.721019 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ac24babf-47ce-4bf2-a549-c58b6a0582b7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:38.721797 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ac24babf-47ce-4bf2-a549-c58b6a0582b7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:38.726651 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-af790771-dd79-446f-b0a0-2fc6ad50de19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:38.728446 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-af790771-dd79-446f-b0a0-2fc6ad50de19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.378595 Nov 23 04:16:38.729154 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 159/375] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:38 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:38.739263 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ac24babf-47ce-4bf2-a549-c58b6a0582b7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:38.739727 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ac24babf-47ce-4bf2-a549-c58b6a0582b7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:38.740556 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ac24babf-47ce-4bf2-a549-c58b6a0582b7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:38.741014 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ac24babf-47ce-4bf2-a549-c58b6a0582b7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:38.968867 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ac24babf-47ce-4bf2-a549-c58b6a0582b7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:38.976827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ac24babf-47ce-4bf2-a549-c58b6a0582b7 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.259315 Nov 23 04:16:38.977425 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 217/376] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:38 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:39.484680 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-1640da7b-b60d-4d69-9577-1b8b2eb5ec16 req-2c7db19c-4f8d-48b0-93ae-0bcdc905eccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da592d1-d534-4643-8e5f-35edefd614b4", "name": "network-vif-deleted", "tag": "2c6f1671-b600-4d12-99a6-94d877dbbfeb"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:39.487475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:16:39.487475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:16:39.499466 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-1640da7b-b60d-4d69-9577-1b8b2eb5ec16 req-2c7db19c-4f8d-48b0-93ae-0bcdc905eccb service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:39.500285 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-1640da7b-b60d-4d69-9577-1b8b2eb5ec16 req-2c7db19c-4f8d-48b0-93ae-0bcdc905eccb service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:39.514624 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-1640da7b-b60d-4d69-9577-1b8b2eb5ec16 req-2c7db19c-4f8d-48b0-93ae-0bcdc905eccb service nova] Creating event network-vif-deleted:2c6f1671-b600-4d12-99a6-94d877dbbfeb for instance 9da592d1-d534-4643-8e5f-35edefd614b4 on hv-cinder-76845 Nov 23 04:16:39.519548 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-1640da7b-b60d-4d69-9577-1b8b2eb5ec16 req-2c7db19c-4f8d-48b0-93ae-0bcdc905eccb service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043532 Nov 23 04:16:39.520132 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 160/377] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:16:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:16:39.732743 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f9f13755-2dc5-45a8-b4a7-c99411e023da tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:39.733351 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f9f13755-2dc5-45a8-b4a7-c99411e023da tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:39.739774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9f13755-2dc5-45a8-b4a7-c99411e023da tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:39.747162 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9f13755-2dc5-45a8-b4a7-c99411e023da tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:39.749156 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9f13755-2dc5-45a8-b4a7-c99411e023da tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:39.749771 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9f13755-2dc5-45a8-b4a7-c99411e023da tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:39.750149 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6832dcba-bae4-4164-9cf4-50e1169ea838 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:39.751406 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6832dcba-bae4-4164-9cf4-50e1169ea838 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:39.757600 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6832dcba-bae4-4164-9cf4-50e1169ea838 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:39.758220 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6832dcba-bae4-4164-9cf4-50e1169ea838 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:39.759794 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6832dcba-bae4-4164-9cf4-50e1169ea838 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:39.760270 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6832dcba-bae4-4164-9cf4-50e1169ea838 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:39.851315 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f9f13755-2dc5-45a8-b4a7-c99411e023da tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:39.882637 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f9f13755-2dc5-45a8-b4a7-c99411e023da tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1300 microversion: 2.1 time: 0.153482 Nov 23 04:16:39.897666 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 218/378] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:39 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1300 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:39.936424 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6832dcba-bae4-4164-9cf4-50e1169ea838 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:39.944371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6832dcba-bae4-4164-9cf4-50e1169ea838 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:39.947181 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6832dcba-bae4-4164-9cf4-50e1169ea838 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:39.952888 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6832dcba-bae4-4164-9cf4-50e1169ea838 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.202623 Nov 23 04:16:39.952888 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 161/379] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:39 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:39.995031 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dba34cf4-e9b1-4570-b842-d3c2c05adaaa tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:39.995689 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dba34cf4-e9b1-4570-b842-d3c2c05adaaa tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:40.001722 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dba34cf4-e9b1-4570-b842-d3c2c05adaaa tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:40.002201 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dba34cf4-e9b1-4570-b842-d3c2c05adaaa tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:40.003051 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dba34cf4-e9b1-4570-b842-d3c2c05adaaa tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:40.003509 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dba34cf4-e9b1-4570-b842-d3c2c05adaaa tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:40.220550 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dba34cf4-e9b1-4570-b842-d3c2c05adaaa tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:40.229246 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dba34cf4-e9b1-4570-b842-d3c2c05adaaa tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.238875 Nov 23 04:16:40.230419 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 219/380] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:39 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:40.904915 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:40.905979 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:40.913929 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:40.913929 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:40.916457 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:40.916922 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:40.951154 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:40.951856 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:40.952466 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lazy-loading 'fault' on Instance uuid 9da592d1-d534-4643-8e5f-35edefd614b4 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:16:40.969976 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-564cb8a9-5b9a-4596-b540-c96adcdde9c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:40.972493 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-564cb8a9-5b9a-4596-b540-c96adcdde9c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:40.987904 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-564cb8a9-5b9a-4596-b540-c96adcdde9c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:40.988553 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-564cb8a9-5b9a-4596-b540-c96adcdde9c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:40.989373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-564cb8a9-5b9a-4596-b540-c96adcdde9c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:40.989815 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-564cb8a9-5b9a-4596-b540-c96adcdde9c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:41.022213 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9afaf378d784aaa90752b936005a687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ed34581a5e4a4b8f22a96ca010c337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:41.034672 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-03cf0d55-8740-476c-b821-becb23b6eaf2 tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 200 len: 1305 microversion: 2.1 time: 0.133522 Nov 23 04:16:41.035584 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 162/381] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:40 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:41.170700 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-564cb8a9-5b9a-4596-b540-c96adcdde9c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:41.180770 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-564cb8a9-5b9a-4596-b540-c96adcdde9c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:41.183751 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-564cb8a9-5b9a-4596-b540-c96adcdde9c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:41.184962 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-564cb8a9-5b9a-4596-b540-c96adcdde9c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.220180 Nov 23 04:16:41.185517 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 220/382] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:40 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:16:41.246356 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-52db38f1-205f-4fd7-9e29-c45eff4415ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:41.246961 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-52db38f1-205f-4fd7-9e29-c45eff4415ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:41.253141 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52db38f1-205f-4fd7-9e29-c45eff4415ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:41.253587 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52db38f1-205f-4fd7-9e29-c45eff4415ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:41.254403 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52db38f1-205f-4fd7-9e29-c45eff4415ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:41.254835 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52db38f1-205f-4fd7-9e29-c45eff4415ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:41.433990 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-52db38f1-205f-4fd7-9e29-c45eff4415ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:41.441889 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-52db38f1-205f-4fd7-9e29-c45eff4415ab tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.199874 Nov 23 04:16:41.442561 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 163/383] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:41 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:42.053121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7e05401a-b236-4256-bbd5-10db065fba5b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:42.054061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7e05401a-b236-4256-bbd5-10db065fba5b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] [instance: 9da592d1-d534-4643-8e5f-35edefd614b4] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:42.061591 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7e05401a-b236-4256-bbd5-10db065fba5b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:42.062331 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7e05401a-b236-4256-bbd5-10db065fba5b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:42.063491 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7e05401a-b236-4256-bbd5-10db065fba5b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:42.063933 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7e05401a-b236-4256-bbd5-10db065fba5b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:42.079823 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-7e05401a-b236-4256-bbd5-10db065fba5b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] HTTP exception thrown: Instance 9da592d1-d534-4643-8e5f-35edefd614b4 could not be found. Nov 23 04:16:42.080420 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7e05401a-b236-4256-bbd5-10db065fba5b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] Returning 404 to user: Instance 9da592d1-d534-4643-8e5f-35edefd614b4 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:16:42.081278 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7e05401a-b236-4256-bbd5-10db065fba5b tempest-VolumesNegativeTest-139795824 tempest-VolumesNegativeTest-139795824-project] 10.222.0.54 "GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4" status: 404 len: 111 microversion: 2.1 time: 0.031860 Nov 23 04:16:42.081894 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 221/384] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:42 2021] GET /compute/v2.1/servers/9da592d1-d534-4643-8e5f-35edefd614b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:16:42.204239 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f423be0a-c906-4343-9eb6-90b63f36a75d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:42.205007 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f423be0a-c906-4343-9eb6-90b63f36a75d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:42.213119 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f423be0a-c906-4343-9eb6-90b63f36a75d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:42.213666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f423be0a-c906-4343-9eb6-90b63f36a75d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:42.214866 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f423be0a-c906-4343-9eb6-90b63f36a75d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:42.215339 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f423be0a-c906-4343-9eb6-90b63f36a75d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:42.390637 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f423be0a-c906-4343-9eb6-90b63f36a75d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:42.393173 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f423be0a-c906-4343-9eb6-90b63f36a75d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:42.394668 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f423be0a-c906-4343-9eb6-90b63f36a75d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:42.395851 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f423be0a-c906-4343-9eb6-90b63f36a75d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.195896 Nov 23 04:16:42.396411 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 164/385] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:42 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:42.461907 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7798dfef-0222-4225-9993-3178e8a5452d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:42.463495 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7798dfef-0222-4225-9993-3178e8a5452d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:42.471242 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7798dfef-0222-4225-9993-3178e8a5452d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:42.471890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7798dfef-0222-4225-9993-3178e8a5452d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:42.472845 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7798dfef-0222-4225-9993-3178e8a5452d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:42.473448 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7798dfef-0222-4225-9993-3178e8a5452d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:42.636363 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-7798dfef-0222-4225-9993-3178e8a5452d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:42.643875 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7798dfef-0222-4225-9993-3178e8a5452d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1500 microversion: 2.1 time: 0.186946 Nov 23 04:16:42.644489 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 222/386] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:42 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1500 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:42.660812 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d3b37649-4252-40b4-8042-a68f739811af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47733213-b7f3-4d4a-802c-74d45dac0735"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:42.661913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d3b37649-4252-40b4-8042-a68f739811af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:42.668351 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d3b37649-4252-40b4-8042-a68f739811af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:42.668798 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d3b37649-4252-40b4-8042-a68f739811af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:42.669666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d3b37649-4252-40b4-8042-a68f739811af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:42.670173 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d3b37649-4252-40b4-8042-a68f739811af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:42.697609 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-d3b37649-4252-40b4-8042-a68f739811af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] HTTP exception thrown: Cannot 'attach_volume' instance 696e3da2-6fdb-4741-8f4f-fffccaf8d403 while it is in vm_state rescued Nov 23 04:16:42.697971 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d3b37649-4252-40b4-8042-a68f739811af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Returning 409 to user: Cannot 'attach_volume' instance 696e3da2-6fdb-4741-8f4f-fffccaf8d403 while it is in vm_state rescued {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:16:42.698803 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d3b37649-4252-40b4-8042-a68f739811af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041863 Nov 23 04:16:42.699380 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 165/387] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:16:42 2021] POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 04:16:42.707853 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2d962559-74eb-43ce-ae3c-13cf1a4c04d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:42.708470 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2d962559-74eb-43ce-ae3c-13cf1a4c04d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:42.715406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d962559-74eb-43ce-ae3c-13cf1a4c04d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:42.716172 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d962559-74eb-43ce-ae3c-13cf1a4c04d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:42.717178 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d962559-74eb-43ce-ae3c-13cf1a4c04d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:42.717587 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d962559-74eb-43ce-ae3c-13cf1a4c04d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:42.996949 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2d962559-74eb-43ce-ae3c-13cf1a4c04d2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/action" status: 202 len: 0 microversion: 2.1 time: 0.292598 Nov 23 04:16:42.997559 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 223/388] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:16:42 2021] POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:16:43.005919 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5d07e5fb-f269-46bd-a8d4-69425eae1c09 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:43.006629 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5d07e5fb-f269-46bd-a8d4-69425eae1c09 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:43.014342 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5d07e5fb-f269-46bd-a8d4-69425eae1c09 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:43.015078 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5d07e5fb-f269-46bd-a8d4-69425eae1c09 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:43.016125 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5d07e5fb-f269-46bd-a8d4-69425eae1c09 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:43.016580 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5d07e5fb-f269-46bd-a8d4-69425eae1c09 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:43.164772 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5d07e5fb-f269-46bd-a8d4-69425eae1c09 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:43.173003 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5d07e5fb-f269-46bd-a8d4-69425eae1c09 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1508 microversion: 2.1 time: 0.170656 Nov 23 04:16:43.173635 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 166/389] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:43 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:43.416765 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-49350242-7f26-4d4f-a8b4-f3eb27a68f14 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:43.417670 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-49350242-7f26-4d4f-a8b4-f3eb27a68f14 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:43.424929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-49350242-7f26-4d4f-a8b4-f3eb27a68f14 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:43.425382 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-49350242-7f26-4d4f-a8b4-f3eb27a68f14 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:43.426174 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-49350242-7f26-4d4f-a8b4-f3eb27a68f14 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:43.426607 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-49350242-7f26-4d4f-a8b4-f3eb27a68f14 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:43.573607 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-49350242-7f26-4d4f-a8b4-f3eb27a68f14 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:43.581512 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-49350242-7f26-4d4f-a8b4-f3eb27a68f14 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:43.582992 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-49350242-7f26-4d4f-a8b4-f3eb27a68f14 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:43.584232 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-49350242-7f26-4d4f-a8b4-f3eb27a68f14 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.173847 Nov 23 04:16:43.584785 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 224/390] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:43 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:44.193254 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-50838b95-2852-42ef-8f93-d0b238575cd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:44.193254 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-50838b95-2852-42ef-8f93-d0b238575cd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:44.197964 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50838b95-2852-42ef-8f93-d0b238575cd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:44.198696 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50838b95-2852-42ef-8f93-d0b238575cd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:44.199273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50838b95-2852-42ef-8f93-d0b238575cd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:44.199758 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50838b95-2852-42ef-8f93-d0b238575cd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:44.362326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-50838b95-2852-42ef-8f93-d0b238575cd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:44.371097 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-50838b95-2852-42ef-8f93-d0b238575cd1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1508 microversion: 2.1 time: 0.184362 Nov 23 04:16:44.371710 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 167/391] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:44 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:44.603235 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-40ea2f52-efa7-4410-9d7b-53ca41ec1c8a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:44.603983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-40ea2f52-efa7-4410-9d7b-53ca41ec1c8a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:44.611341 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40ea2f52-efa7-4410-9d7b-53ca41ec1c8a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:44.611917 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40ea2f52-efa7-4410-9d7b-53ca41ec1c8a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:44.612714 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40ea2f52-efa7-4410-9d7b-53ca41ec1c8a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:44.613153 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40ea2f52-efa7-4410-9d7b-53ca41ec1c8a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:44.745664 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-40ea2f52-efa7-4410-9d7b-53ca41ec1c8a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:44.800735 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-40ea2f52-efa7-4410-9d7b-53ca41ec1c8a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:44.800735 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-40ea2f52-efa7-4410-9d7b-53ca41ec1c8a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:44.800735 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-40ea2f52-efa7-4410-9d7b-53ca41ec1c8a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.157879 Nov 23 04:16:44.801304 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 225/392] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:44 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:45.389905 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4ceeea80-901a-4c37-8911-68177e57c16c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:45.390444 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4ceeea80-901a-4c37-8911-68177e57c16c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:45.397068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ceeea80-901a-4c37-8911-68177e57c16c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:45.401439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ceeea80-901a-4c37-8911-68177e57c16c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:45.401439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ceeea80-901a-4c37-8911-68177e57c16c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:45.401439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ceeea80-901a-4c37-8911-68177e57c16c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:45.778307 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4ceeea80-901a-4c37-8911-68177e57c16c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:45.789077 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4ceeea80-901a-4c37-8911-68177e57c16c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1508 microversion: 2.1 time: 0.402954 Nov 23 04:16:45.790965 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 168/393] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:45 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:45.818006 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f168cb03-9446-49c0-b747-105ece8cffe2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:45.818732 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f168cb03-9446-49c0-b747-105ece8cffe2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:45.828159 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f168cb03-9446-49c0-b747-105ece8cffe2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:45.830494 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f168cb03-9446-49c0-b747-105ece8cffe2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:45.830494 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f168cb03-9446-49c0-b747-105ece8cffe2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:45.830494 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f168cb03-9446-49c0-b747-105ece8cffe2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:46.050407 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f168cb03-9446-49c0-b747-105ece8cffe2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:46.062634 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f168cb03-9446-49c0-b747-105ece8cffe2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:46.064055 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f168cb03-9446-49c0-b747-105ece8cffe2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:46.065252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f168cb03-9446-49c0-b747-105ece8cffe2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.252164 Nov 23 04:16:46.076226 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 226/394] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:45 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:46.808339 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-01e5cdcb-b6b4-4e27-8d05-7ac436cf6b5d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:46.808961 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-01e5cdcb-b6b4-4e27-8d05-7ac436cf6b5d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:46.815546 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-01e5cdcb-b6b4-4e27-8d05-7ac436cf6b5d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:46.820551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-01e5cdcb-b6b4-4e27-8d05-7ac436cf6b5d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:46.820551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-01e5cdcb-b6b4-4e27-8d05-7ac436cf6b5d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:46.820551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-01e5cdcb-b6b4-4e27-8d05-7ac436cf6b5d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:46.960067 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-01e5cdcb-b6b4-4e27-8d05-7ac436cf6b5d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:46.970325 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-01e5cdcb-b6b4-4e27-8d05-7ac436cf6b5d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1508 microversion: 2.1 time: 0.166973 Nov 23 04:16:46.971057 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 169/395] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:46 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:47.084458 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a966f1d4-b8bf-4bd3-bdb1-0403a4bbb02b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:47.084947 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a966f1d4-b8bf-4bd3-bdb1-0403a4bbb02b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:47.094465 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a966f1d4-b8bf-4bd3-bdb1-0403a4bbb02b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:47.094931 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a966f1d4-b8bf-4bd3-bdb1-0403a4bbb02b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:47.095760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a966f1d4-b8bf-4bd3-bdb1-0403a4bbb02b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:47.096195 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a966f1d4-b8bf-4bd3-bdb1-0403a4bbb02b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:47.209891 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-be967782-88a1-425f-a3f0-d7dd949bc1c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c236ad20-0310-4d97-836a-b8d02184cd67"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:47.211180 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-be967782-88a1-425f-a3f0-d7dd949bc1c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:47.219395 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-be967782-88a1-425f-a3f0-d7dd949bc1c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:47.219395 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-be967782-88a1-425f-a3f0-d7dd949bc1c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:47.221177 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-be967782-88a1-425f-a3f0-d7dd949bc1c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:47.221177 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-be967782-88a1-425f-a3f0-d7dd949bc1c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:47.290705 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a966f1d4-b8bf-4bd3-bdb1-0403a4bbb02b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:47.302880 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a966f1d4-b8bf-4bd3-bdb1-0403a4bbb02b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:47.304838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a966f1d4-b8bf-4bd3-bdb1-0403a4bbb02b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:47.306966 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a966f1d4-b8bf-4bd3-bdb1-0403a4bbb02b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.225656 Nov 23 04:16:47.307919 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 227/396] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:47 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:47.343858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-be967782-88a1-425f-a3f0-d7dd949bc1c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] HTTP exception thrown: Invalid volume: volume c236ad20-0310-4d97-836a-b8d02184cd67 is already attached to instances: cf175718-dca3-4da3-a676-f5d4d54f54e2 Nov 23 04:16:47.344467 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-be967782-88a1-425f-a3f0-d7dd949bc1c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Returning 400 to user: Invalid volume: volume c236ad20-0310-4d97-836a-b8d02184cd67 is already attached to instances: cf175718-dca3-4da3-a676-f5d4d54f54e2 {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:16:47.345353 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-be967782-88a1-425f-a3f0-d7dd949bc1c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "POST /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.139567 Nov 23 04:16:47.345952 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 170/397] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:16:47 2021] POST /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 23 04:16:47.420814 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-83eb23d0-d7ad-40d9-96c4-abfad8572375 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:47.422774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-83eb23d0-d7ad-40d9-96c4-abfad8572375 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:47.427637 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-83eb23d0-d7ad-40d9-96c4-abfad8572375 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:47.428090 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-83eb23d0-d7ad-40d9-96c4-abfad8572375 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:47.428915 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-83eb23d0-d7ad-40d9-96c4-abfad8572375 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:47.429350 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-83eb23d0-d7ad-40d9-96c4-abfad8572375 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:47.573466 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-83eb23d0-d7ad-40d9-96c4-abfad8572375 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lazy-loading 'services' on Instance uuid cf175718-dca3-4da3-a676-f5d4d54f54e2 {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:16:47.894157 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-83eb23d0-d7ad-40d9-96c4-abfad8572375 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "DELETE /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments/c236ad20-0310-4d97-836a-b8d02184cd67" status: 202 len: 0 microversion: 2.1 time: 0.476792 Nov 23 04:16:47.895138 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 228/398] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:16:47 2021] DELETE /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments/c236ad20-0310-4d97-836a-b8d02184cd67 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:16:47.904379 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0c53a276-00f9-4a2b-beb5-f692ca8ce781 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:47.905925 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0c53a276-00f9-4a2b-beb5-f692ca8ce781 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:47.915563 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0c53a276-00f9-4a2b-beb5-f692ca8ce781 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:47.921230 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0c53a276-00f9-4a2b-beb5-f692ca8ce781 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:47.921230 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0c53a276-00f9-4a2b-beb5-f692ca8ce781 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:47.921230 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0c53a276-00f9-4a2b-beb5-f692ca8ce781 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:47.951081 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0c53a276-00f9-4a2b-beb5-f692ca8ce781 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050619 Nov 23 04:16:47.951804 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 171/399] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:16:47 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:16:47.989715 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b93da497-369d-4730-a3e0-9403d0ecdb7c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:47.991043 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b93da497-369d-4730-a3e0-9403d0ecdb7c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:48.000830 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b93da497-369d-4730-a3e0-9403d0ecdb7c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:48.001476 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b93da497-369d-4730-a3e0-9403d0ecdb7c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:48.002443 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b93da497-369d-4730-a3e0-9403d0ecdb7c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:48.002940 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b93da497-369d-4730-a3e0-9403d0ecdb7c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:48.176842 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b93da497-369d-4730-a3e0-9403d0ecdb7c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:48.189001 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b93da497-369d-4730-a3e0-9403d0ecdb7c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1508 microversion: 2.1 time: 0.204085 Nov 23 04:16:48.190319 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 229/400] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:47 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:48.332646 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1e62bd40-ee45-46c9-86d3-f1b20a7fe3fc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:48.342704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1e62bd40-ee45-46c9-86d3-f1b20a7fe3fc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:48.342704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e62bd40-ee45-46c9-86d3-f1b20a7fe3fc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:48.342704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e62bd40-ee45-46c9-86d3-f1b20a7fe3fc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:48.342704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e62bd40-ee45-46c9-86d3-f1b20a7fe3fc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:48.343882 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e62bd40-ee45-46c9-86d3-f1b20a7fe3fc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:48.491957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1e62bd40-ee45-46c9-86d3-f1b20a7fe3fc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:48.501218 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1e62bd40-ee45-46c9-86d3-f1b20a7fe3fc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:48.503134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1e62bd40-ee45-46c9-86d3-f1b20a7fe3fc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:48.504559 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1e62bd40-ee45-46c9-86d3-f1b20a7fe3fc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.178275 Nov 23 04:16:48.505265 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 172/401] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:48 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:48.961790 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-096c8816-844f-49ce-b1f4-83092a35b124 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:48.962926 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-096c8816-844f-49ce-b1f4-83092a35b124 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:48.968606 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-096c8816-844f-49ce-b1f4-83092a35b124 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:48.969087 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-096c8816-844f-49ce-b1f4-83092a35b124 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:48.969920 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-096c8816-844f-49ce-b1f4-83092a35b124 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:48.970299 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-096c8816-844f-49ce-b1f4-83092a35b124 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:49.003871 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-096c8816-844f-49ce-b1f4-83092a35b124 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Nov 23 04:16:49.003871 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 230/402] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:16:48 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:16:49.206373 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-47d341b4-582a-4447-be86-f35bf750c8e2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:49.206753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-47d341b4-582a-4447-be86-f35bf750c8e2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:49.213919 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-47d341b4-582a-4447-be86-f35bf750c8e2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:49.214390 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-47d341b4-582a-4447-be86-f35bf750c8e2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:49.215172 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-47d341b4-582a-4447-be86-f35bf750c8e2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:49.215631 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-47d341b4-582a-4447-be86-f35bf750c8e2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:49.351391 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-47d341b4-582a-4447-be86-f35bf750c8e2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:49.359162 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-47d341b4-582a-4447-be86-f35bf750c8e2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1514 microversion: 2.1 time: 0.156832 Nov 23 04:16:49.359759 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 173/403] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:49 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:49.523197 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dc7e53f2-5f30-42f0-adfc-b493458b0f4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:49.523854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dc7e53f2-5f30-42f0-adfc-b493458b0f4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:49.530831 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc7e53f2-5f30-42f0-adfc-b493458b0f4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:49.531317 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc7e53f2-5f30-42f0-adfc-b493458b0f4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:49.532130 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc7e53f2-5f30-42f0-adfc-b493458b0f4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:49.532563 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc7e53f2-5f30-42f0-adfc-b493458b0f4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:49.664066 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dc7e53f2-5f30-42f0-adfc-b493458b0f4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:49.674163 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dc7e53f2-5f30-42f0-adfc-b493458b0f4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:49.674163 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dc7e53f2-5f30-42f0-adfc-b493458b0f4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:49.675092 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dc7e53f2-5f30-42f0-adfc-b493458b0f4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.155534 Nov 23 04:16:49.675821 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 231/404] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:49 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:50.013915 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3f80ed7f-9dc9-4f3c-b06f-cff045369743 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:50.014812 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3f80ed7f-9dc9-4f3c-b06f-cff045369743 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:50.021154 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3f80ed7f-9dc9-4f3c-b06f-cff045369743 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:50.021603 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3f80ed7f-9dc9-4f3c-b06f-cff045369743 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:50.022715 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3f80ed7f-9dc9-4f3c-b06f-cff045369743 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:50.023290 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3f80ed7f-9dc9-4f3c-b06f-cff045369743 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:50.053551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3f80ed7f-9dc9-4f3c-b06f-cff045369743 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043374 Nov 23 04:16:50.054300 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 174/405] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:16:50 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 04:16:50.385760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2060843035", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "networks": [{"uuid": "3f225ae5-6bd1-4fef-a8a2-1e95224823f9"}]}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:50.440756 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] validate_networks() for [('3f225ae5-6bd1-4fef-a8a2-1e95224823f9', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:16:50.695768 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8ddc7cf4-7755-4875-8057-aaa12f0131e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:50.697255 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8ddc7cf4-7755-4875-8057-aaa12f0131e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:50.705862 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8ddc7cf4-7755-4875-8057-aaa12f0131e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:50.706629 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8ddc7cf4-7755-4875-8057-aaa12f0131e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:50.707880 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8ddc7cf4-7755-4875-8057-aaa12f0131e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:50.721568 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8ddc7cf4-7755-4875-8057-aaa12f0131e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:50.973021 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8ddc7cf4-7755-4875-8057-aaa12f0131e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:50.986738 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8ddc7cf4-7755-4875-8057-aaa12f0131e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:50.988657 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8ddc7cf4-7755-4875-8057-aaa12f0131e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:50.990655 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8ddc7cf4-7755-4875-8057-aaa12f0131e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.300528 Nov 23 04:16:50.991349 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 175/406] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:50 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:16:50.996911 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:16:50.997365 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:16:50.997791 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:16:50.998994 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:16:50.999694 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:16:51.011743 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:51.012351 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:51.013291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:51.013959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:51.031830 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Getting quotas for project dc51e914f5e74ceca4086caa5a05b8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:16:51.037098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Getting quotas for user 882a63823deb40dcb93ddc76f81ab9d0 and project dc51e914f5e74ceca4086caa5a05b8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:16:51.049921 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:16:51.052280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:16:51.213863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-acf0503e-d5ec-439a-9455-6a30d1322519 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830813 Nov 23 04:16:51.218102 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 232/407] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:16:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 04:16:51.222996 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9c8653d4-aec4-4813-a635-11faf4a35f7a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:51.223692 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9c8653d4-aec4-4813-a635-11faf4a35f7a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:51.296134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9c8653d4-aec4-4813-a635-11faf4a35f7a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:51.308069 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9c8653d4-aec4-4813-a635-11faf4a35f7a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1218 microversion: 2.1 time: 0.086869 Nov 23 04:16:51.308660 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 176/408] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:51 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:51.432130 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dc497e6e-1977-45da-a993-e9a9578f0b04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:51.432839 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dc497e6e-1977-45da-a993-e9a9578f0b04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:51.439311 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc497e6e-1977-45da-a993-e9a9578f0b04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:51.439829 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc497e6e-1977-45da-a993-e9a9578f0b04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:51.440711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc497e6e-1977-45da-a993-e9a9578f0b04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:51.441228 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc497e6e-1977-45da-a993-e9a9578f0b04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:51.582735 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dc497e6e-1977-45da-a993-e9a9578f0b04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:51.590259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dc497e6e-1977-45da-a993-e9a9578f0b04 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1514 microversion: 2.1 time: 0.162200 Nov 23 04:16:51.590817 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 233/409] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:51 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:51.607287 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f9a6fc42-d41d-441c-bd1b-5c3437a82dbb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b90a1ac4-8fa1-4bc4-a1bd-cc5efd87b7f3"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:51.608419 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f9a6fc42-d41d-441c-bd1b-5c3437a82dbb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:51.614388 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f9a6fc42-d41d-441c-bd1b-5c3437a82dbb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:51.619055 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f9a6fc42-d41d-441c-bd1b-5c3437a82dbb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:51.619055 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f9a6fc42-d41d-441c-bd1b-5c3437a82dbb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:51.619055 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f9a6fc42-d41d-441c-bd1b-5c3437a82dbb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:52.010436 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-72c72238-fd1d-4f4b-a867-f357cc74cf35 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:52.011360 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-72c72238-fd1d-4f4b-a867-f357cc74cf35 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:52.017945 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-72c72238-fd1d-4f4b-a867-f357cc74cf35 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:52.018479 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-72c72238-fd1d-4f4b-a867-f357cc74cf35 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:52.019297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-72c72238-fd1d-4f4b-a867-f357cc74cf35 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:52.019758 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-72c72238-fd1d-4f4b-a867-f357cc74cf35 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:52.221076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-72c72238-fd1d-4f4b-a867-f357cc74cf35 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:52.229173 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-72c72238-fd1d-4f4b-a867-f357cc74cf35 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:52.230642 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-72c72238-fd1d-4f4b-a867-f357cc74cf35 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:52.231824 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-72c72238-fd1d-4f4b-a867-f357cc74cf35 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.225963 Nov 23 04:16:52.232362 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 234/410] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:52 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:16:52.325978 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-94bdc861-bbc6-4d96-90f7-ec5c7809a96b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:52.326584 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-94bdc861-bbc6-4d96-90f7-ec5c7809a96b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:52.332245 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-94bdc861-bbc6-4d96-90f7-ec5c7809a96b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:52.332705 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-94bdc861-bbc6-4d96-90f7-ec5c7809a96b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:52.333459 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-94bdc861-bbc6-4d96-90f7-ec5c7809a96b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:52.333892 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-94bdc861-bbc6-4d96-90f7-ec5c7809a96b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:52.395449 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-94bdc861-bbc6-4d96-90f7-ec5c7809a96b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:52.403451 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-94bdc861-bbc6-4d96-90f7-ec5c7809a96b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1222 microversion: 2.1 time: 0.081094 Nov 23 04:16:52.405871 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 235/411] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:52 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:53.262408 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-521dc3bd-5ac3-492c-8d1d-7991d0a85a49 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:53.263036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-521dc3bd-5ac3-492c-8d1d-7991d0a85a49 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:53.269485 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-521dc3bd-5ac3-492c-8d1d-7991d0a85a49 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:53.269959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-521dc3bd-5ac3-492c-8d1d-7991d0a85a49 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:53.270727 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-521dc3bd-5ac3-492c-8d1d-7991d0a85a49 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:53.271154 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-521dc3bd-5ac3-492c-8d1d-7991d0a85a49 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:53.415671 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-521dc3bd-5ac3-492c-8d1d-7991d0a85a49 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:53.423515 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-521dc3bd-5ac3-492c-8d1d-7991d0a85a49 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:53.425096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-521dc3bd-5ac3-492c-8d1d-7991d0a85a49 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:53.427318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-521dc3bd-5ac3-492c-8d1d-7991d0a85a49 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.169444 Nov 23 04:16:53.428210 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 236/412] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:53 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:16:53.439712 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1cd31e1b-ba3b-450e-a0b2-f374f8dc5736 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:53.440331 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1cd31e1b-ba3b-450e-a0b2-f374f8dc5736 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:53.446792 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1cd31e1b-ba3b-450e-a0b2-f374f8dc5736 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:53.447253 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1cd31e1b-ba3b-450e-a0b2-f374f8dc5736 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:53.448032 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1cd31e1b-ba3b-450e-a0b2-f374f8dc5736 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:53.454167 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1cd31e1b-ba3b-450e-a0b2-f374f8dc5736 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:53.506723 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1cd31e1b-ba3b-450e-a0b2-f374f8dc5736 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:53.584910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1cd31e1b-ba3b-450e-a0b2-f374f8dc5736 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1222 microversion: 2.1 time: 0.155377 Nov 23 04:16:53.585496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 237/413] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:53 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:54.447739 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-26150a10-ed88-4ae3-8778-1429ff7256f0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:54.448580 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-26150a10-ed88-4ae3-8778-1429ff7256f0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:54.454698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-26150a10-ed88-4ae3-8778-1429ff7256f0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:54.455161 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-26150a10-ed88-4ae3-8778-1429ff7256f0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:54.455975 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-26150a10-ed88-4ae3-8778-1429ff7256f0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:54.456442 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-26150a10-ed88-4ae3-8778-1429ff7256f0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:54.614805 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-26150a10-ed88-4ae3-8778-1429ff7256f0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:54.623759 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-26150a10-ed88-4ae3-8778-1429ff7256f0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:54.625617 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-26150a10-ed88-4ae3-8778-1429ff7256f0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:54.626869 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-26150a10-ed88-4ae3-8778-1429ff7256f0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.183594 Nov 23 04:16:54.627458 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 238/414] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:54 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:16:54.631692 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-85c73903-a5d9-4a61-bb5c-a9db3f9ff0e0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:54.632593 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-85c73903-a5d9-4a61-bb5c-a9db3f9ff0e0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:54.638889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-85c73903-a5d9-4a61-bb5c-a9db3f9ff0e0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:54.639401 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-85c73903-a5d9-4a61-bb5c-a9db3f9ff0e0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:54.640378 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-85c73903-a5d9-4a61-bb5c-a9db3f9ff0e0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:54.640897 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-85c73903-a5d9-4a61-bb5c-a9db3f9ff0e0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:54.704161 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-85c73903-a5d9-4a61-bb5c-a9db3f9ff0e0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:54.713247 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-85c73903-a5d9-4a61-bb5c-a9db3f9ff0e0 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1222 microversion: 2.1 time: 0.083620 Nov 23 04:16:54.713929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 239/415] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:54 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:55.318574 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f9a6fc42-d41d-441c-bd1b-5c3437a82dbb tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.715046 Nov 23 04:16:55.319808 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 177/416] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:16:51 2021] POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 194 bytes in 3718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:16:55.646267 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9d055b0f-53ea-43dd-af4b-e00cfda4570a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:55.647030 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9d055b0f-53ea-43dd-af4b-e00cfda4570a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:55.653360 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9d055b0f-53ea-43dd-af4b-e00cfda4570a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:55.653925 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9d055b0f-53ea-43dd-af4b-e00cfda4570a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:55.654655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9d055b0f-53ea-43dd-af4b-e00cfda4570a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:55.655066 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9d055b0f-53ea-43dd-af4b-e00cfda4570a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:55.733834 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bc472190-9b8d-4329-8802-de9823a8b432 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:55.734811 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-bc472190-9b8d-4329-8802-de9823a8b432 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:55.743264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bc472190-9b8d-4329-8802-de9823a8b432 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:55.743800 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bc472190-9b8d-4329-8802-de9823a8b432 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:55.744700 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bc472190-9b8d-4329-8802-de9823a8b432 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:55.745476 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bc472190-9b8d-4329-8802-de9823a8b432 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:55.836287 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bc472190-9b8d-4329-8802-de9823a8b432 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:55.843732 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9d055b0f-53ea-43dd-af4b-e00cfda4570a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:55.848434 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bc472190-9b8d-4329-8802-de9823a8b432 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1270 microversion: 2.1 time: 0.117961 Nov 23 04:16:55.848434 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 178/417] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:55 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:16:55.855929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9d055b0f-53ea-43dd-af4b-e00cfda4570a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:55.857598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9d055b0f-53ea-43dd-af4b-e00cfda4570a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:55.858844 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9d055b0f-53ea-43dd-af4b-e00cfda4570a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.216285 Nov 23 04:16:55.859741 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 240/418] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:55 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:56.865458 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-12882cb7-8f1b-4942-b870-dc0382dee423 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:56.871596 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-12882cb7-8f1b-4942-b870-dc0382dee423 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:56.876388 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-12882cb7-8f1b-4942-b870-dc0382dee423 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:56.876843 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-12882cb7-8f1b-4942-b870-dc0382dee423 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:56.877633 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-12882cb7-8f1b-4942-b870-dc0382dee423 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:56.878069 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-12882cb7-8f1b-4942-b870-dc0382dee423 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:56.878707 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-465ca481-5209-4e1d-a4a0-8fbe468d9cf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:56.879993 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-465ca481-5209-4e1d-a4a0-8fbe468d9cf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:56.894069 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-465ca481-5209-4e1d-a4a0-8fbe468d9cf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:56.894799 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-465ca481-5209-4e1d-a4a0-8fbe468d9cf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:56.895835 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-465ca481-5209-4e1d-a4a0-8fbe468d9cf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:56.897505 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-465ca481-5209-4e1d-a4a0-8fbe468d9cf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:57.005398 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-12882cb7-8f1b-4942-b870-dc0382dee423 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:57.013172 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-12882cb7-8f1b-4942-b870-dc0382dee423 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1276 microversion: 2.1 time: 0.151668 Nov 23 04:16:57.019647 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 179/419] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:56 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:57.239158 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-465ca481-5209-4e1d-a4a0-8fbe468d9cf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:57.275040 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-465ca481-5209-4e1d-a4a0-8fbe468d9cf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:57.275040 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-465ca481-5209-4e1d-a4a0-8fbe468d9cf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:57.275040 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-465ca481-5209-4e1d-a4a0-8fbe468d9cf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.389175 Nov 23 04:16:57.275716 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 241/420] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:56 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:58.048606 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e917d7df-43e5-45a5-b9a9-37d9aa03e413 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:58.050716 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e917d7df-43e5-45a5-b9a9-37d9aa03e413 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:58.060169 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e917d7df-43e5-45a5-b9a9-37d9aa03e413 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:58.060622 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e917d7df-43e5-45a5-b9a9-37d9aa03e413 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:58.061431 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e917d7df-43e5-45a5-b9a9-37d9aa03e413 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:58.068880 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e917d7df-43e5-45a5-b9a9-37d9aa03e413 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:58.293254 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-33c26288-ac2a-45b5-b3a8-dba2c27c5b4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:58.297755 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-33c26288-ac2a-45b5-b3a8-dba2c27c5b4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:58.316215 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-33c26288-ac2a-45b5-b3a8-dba2c27c5b4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:58.317460 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-33c26288-ac2a-45b5-b3a8-dba2c27c5b4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:58.319392 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-33c26288-ac2a-45b5-b3a8-dba2c27c5b4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:58.322652 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-33c26288-ac2a-45b5-b3a8-dba2c27c5b4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:58.386170 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e917d7df-43e5-45a5-b9a9-37d9aa03e413 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:58.406271 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e917d7df-43e5-45a5-b9a9-37d9aa03e413 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1318 microversion: 2.1 time: 0.367339 Nov 23 04:16:58.407490 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 180/421] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:58 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:16:58.635868 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-33c26288-ac2a-45b5-b3a8-dba2c27c5b4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:58.650529 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-33c26288-ac2a-45b5-b3a8-dba2c27c5b4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:58.653861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-33c26288-ac2a-45b5-b3a8-dba2c27c5b4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:16:58.657529 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-33c26288-ac2a-45b5-b3a8-dba2c27c5b4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1740 microversion: 2.20 time: 0.375271 Nov 23 04:16:58.660216 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 242/422] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:58 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:16:58.895851 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-b8b88027-9900-4a42-8efc-7a91ced7e68d req-89bca918-2efd-46e0-a374-8394ad3dfa36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5694f710-d745-44e4-9b59-55d54a09515d", "tag": "17ac3a98-501a-42f8-b6c9-52d0039362e2"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:16:58.919939 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:16:58.919939 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:16:58.942139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-b8b88027-9900-4a42-8efc-7a91ced7e68d req-89bca918-2efd-46e0-a374-8394ad3dfa36 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:58.942873 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-b8b88027-9900-4a42-8efc-7a91ced7e68d req-89bca918-2efd-46e0-a374-8394ad3dfa36 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:58.970364 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-b8b88027-9900-4a42-8efc-7a91ced7e68d req-89bca918-2efd-46e0-a374-8394ad3dfa36 service nova] Creating event network-changed:17ac3a98-501a-42f8-b6c9-52d0039362e2 for instance 5694f710-d745-44e4-9b59-55d54a09515d on hv-cinder-76845 Nov 23 04:16:58.983643 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-b8b88027-9900-4a42-8efc-7a91ced7e68d req-89bca918-2efd-46e0-a374-8394ad3dfa36 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100342 Nov 23 04:16:58.986987 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 181/423] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:16:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:16:59.433129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6b32505c-1a58-48ec-9279-91502825167a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:59.433129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6b32505c-1a58-48ec-9279-91502825167a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:59.438731 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6b32505c-1a58-48ec-9279-91502825167a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:59.439108 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6b32505c-1a58-48ec-9279-91502825167a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:59.439963 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6b32505c-1a58-48ec-9279-91502825167a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:59.444892 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6b32505c-1a58-48ec-9279-91502825167a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:59.681013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2a41d652-5572-48cc-b1cf-42cb00c099be tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:16:59.681845 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2a41d652-5572-48cc-b1cf-42cb00c099be tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:16:59.714166 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2a41d652-5572-48cc-b1cf-42cb00c099be tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:59.714749 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2a41d652-5572-48cc-b1cf-42cb00c099be tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:16:59.718355 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2a41d652-5572-48cc-b1cf-42cb00c099be tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:16:59.718961 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2a41d652-5572-48cc-b1cf-42cb00c099be tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:00.014224 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6b32505c-1a58-48ec-9279-91502825167a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:00.021743 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6b32505c-1a58-48ec-9279-91502825167a tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1318 microversion: 2.1 time: 0.600635 Nov 23 04:17:00.031695 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2a41d652-5572-48cc-b1cf-42cb00c099be tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:00.032474 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 243/424] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:16:59 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:00.034959 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2a41d652-5572-48cc-b1cf-42cb00c099be tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:00.036191 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2a41d652-5572-48cc-b1cf-42cb00c099be tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:00.037748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2a41d652-5572-48cc-b1cf-42cb00c099be tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1740 microversion: 2.20 time: 0.364365 Nov 23 04:17:00.038451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 182/425] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:16:59 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1740 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:01.043863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c5423630-90ec-4bcc-9290-93dc346b8d81 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:01.044640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c5423630-90ec-4bcc-9290-93dc346b8d81 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:01.051848 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5423630-90ec-4bcc-9290-93dc346b8d81 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:01.052513 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5423630-90ec-4bcc-9290-93dc346b8d81 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:01.053280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5423630-90ec-4bcc-9290-93dc346b8d81 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:01.053835 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5423630-90ec-4bcc-9290-93dc346b8d81 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:01.057717 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d9c3a148-65b3-45c6-a305-7aba0daab9ff tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:01.058402 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d9c3a148-65b3-45c6-a305-7aba0daab9ff tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:01.068417 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9c3a148-65b3-45c6-a305-7aba0daab9ff tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:01.068975 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9c3a148-65b3-45c6-a305-7aba0daab9ff tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:01.069840 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9c3a148-65b3-45c6-a305-7aba0daab9ff tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:01.070362 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9c3a148-65b3-45c6-a305-7aba0daab9ff tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:01.392005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d9c3a148-65b3-45c6-a305-7aba0daab9ff tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:01.402094 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d9c3a148-65b3-45c6-a305-7aba0daab9ff tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:01.406531 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d9c3a148-65b3-45c6-a305-7aba0daab9ff tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:01.407781 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d9c3a148-65b3-45c6-a305-7aba0daab9ff tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.355070 Nov 23 04:17:01.426798 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 183/426] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:01 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:01.428292 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c5423630-90ec-4bcc-9290-93dc346b8d81 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:01.439348 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c5423630-90ec-4bcc-9290-93dc346b8d81 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1318 microversion: 2.1 time: 0.403198 Nov 23 04:17:01.440130 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 244/427] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:01 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:02.435997 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0378dc56-94cd-4032-82d2-4421b44fc507 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:02.437345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0378dc56-94cd-4032-82d2-4421b44fc507 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:02.444320 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0378dc56-94cd-4032-82d2-4421b44fc507 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:02.445059 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0378dc56-94cd-4032-82d2-4421b44fc507 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:02.446200 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0378dc56-94cd-4032-82d2-4421b44fc507 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:02.446929 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0378dc56-94cd-4032-82d2-4421b44fc507 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:02.459477 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8bae8ab4-d04e-4d64-a646-2b0f8bfb9e6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:02.460161 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8bae8ab4-d04e-4d64-a646-2b0f8bfb9e6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:02.485556 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8bae8ab4-d04e-4d64-a646-2b0f8bfb9e6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:02.488580 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8bae8ab4-d04e-4d64-a646-2b0f8bfb9e6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:02.489627 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8bae8ab4-d04e-4d64-a646-2b0f8bfb9e6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:02.490898 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8bae8ab4-d04e-4d64-a646-2b0f8bfb9e6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:02.749899 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0378dc56-94cd-4032-82d2-4421b44fc507 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:02.763509 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0378dc56-94cd-4032-82d2-4421b44fc507 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:02.771014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0378dc56-94cd-4032-82d2-4421b44fc507 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:02.771014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0378dc56-94cd-4032-82d2-4421b44fc507 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.336440 Nov 23 04:17:02.771014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 184/428] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:02 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:02.785113 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8bae8ab4-d04e-4d64-a646-2b0f8bfb9e6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:02.793041 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8bae8ab4-d04e-4d64-a646-2b0f8bfb9e6f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1318 microversion: 2.1 time: 0.337949 Nov 23 04:17:02.793609 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 245/429] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:02 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:03.791802 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-5d6219d1-7cd4-408f-86dc-26ec3846f68e req-005246d5-6630-41ed-995f-c65560f81a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c13d4db-587d-4d4e-b8cc-23632d768572", "name": "network-vif-plugged", "status": "completed", "tag": "1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:03.791802 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:17:03.791802 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:17:03.791802 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-5d6219d1-7cd4-408f-86dc-26ec3846f68e req-005246d5-6630-41ed-995f-c65560f81a2b service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:03.791802 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-5d6219d1-7cd4-408f-86dc-26ec3846f68e req-005246d5-6630-41ed-995f-c65560f81a2b service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:03.794209 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-5d6219d1-7cd4-408f-86dc-26ec3846f68e req-005246d5-6630-41ed-995f-c65560f81a2b service nova] Creating event network-vif-plugged:1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2 for instance 8c13d4db-587d-4d4e-b8cc-23632d768572 on hv-cinder-76845 Nov 23 04:17:03.794209 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-5d6219d1-7cd4-408f-86dc-26ec3846f68e req-005246d5-6630-41ed-995f-c65560f81a2b service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070213 Nov 23 04:17:03.794209 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 185/430] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:17:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:03.794852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3c264c92-336e-463f-908e-18c33bee53ec tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:03.794852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3c264c92-336e-463f-908e-18c33bee53ec tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:03.794852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c264c92-336e-463f-908e-18c33bee53ec tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:03.794852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c264c92-336e-463f-908e-18c33bee53ec tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:03.795886 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c264c92-336e-463f-908e-18c33bee53ec tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:03.795886 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c264c92-336e-463f-908e-18c33bee53ec tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:03.810706 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e0639c76-8f7d-4fe5-aa19-d96f68a9f493 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:03.812339 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e0639c76-8f7d-4fe5-aa19-d96f68a9f493 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:03.825189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e0639c76-8f7d-4fe5-aa19-d96f68a9f493 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:03.826335 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e0639c76-8f7d-4fe5-aa19-d96f68a9f493 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:03.827527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e0639c76-8f7d-4fe5-aa19-d96f68a9f493 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:03.828160 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e0639c76-8f7d-4fe5-aa19-d96f68a9f493 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:04.040929 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e0639c76-8f7d-4fe5-aa19-d96f68a9f493 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:04.049415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3c264c92-336e-463f-908e-18c33bee53ec tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:04.050405 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e0639c76-8f7d-4fe5-aa19-d96f68a9f493 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1318 microversion: 2.1 time: 0.243788 Nov 23 04:17:04.051234 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 186/431] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:03 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:04.064578 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3c264c92-336e-463f-908e-18c33bee53ec tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:04.066077 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3c264c92-336e-463f-908e-18c33bee53ec tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:04.067511 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3c264c92-336e-463f-908e-18c33bee53ec tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.284996 Nov 23 04:17:04.068225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 246/432] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:03 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:04.907752 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ff77ff4b-a1e6-4115-9dd7-560d1d0b03c3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:04.911240 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ff77ff4b-a1e6-4115-9dd7-560d1d0b03c3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:04.928413 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff77ff4b-a1e6-4115-9dd7-560d1d0b03c3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:04.932907 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff77ff4b-a1e6-4115-9dd7-560d1d0b03c3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:04.934066 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff77ff4b-a1e6-4115-9dd7-560d1d0b03c3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:04.934757 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff77ff4b-a1e6-4115-9dd7-560d1d0b03c3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:05.009019 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-ff77ff4b-a1e6-4115-9dd7-560d1d0b03c3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lazy-loading 'flavor' on Instance uuid 696e3da2-6fdb-4741-8f4f-fffccaf8d403 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:17:05.068695 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ef315815-a63e-4fc0-ac1e-0a054332cbbf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:05.087041 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ef315815-a63e-4fc0-ac1e-0a054332cbbf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:05.087041 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ef315815-a63e-4fc0-ac1e-0a054332cbbf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:05.089041 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ef315815-a63e-4fc0-ac1e-0a054332cbbf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:05.090017 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ef315815-a63e-4fc0-ac1e-0a054332cbbf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:05.090452 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ef315815-a63e-4fc0-ac1e-0a054332cbbf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:05.316822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ef315815-a63e-4fc0-ac1e-0a054332cbbf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:05.338481 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ef315815-a63e-4fc0-ac1e-0a054332cbbf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1318 microversion: 2.1 time: 0.263175 Nov 23 04:17:05.338481 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 247/433] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:05 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:05.342628 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-65f59f7b-a7a8-4a64-a143-74d99c88337c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:05.343511 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-65f59f7b-a7a8-4a64-a143-74d99c88337c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:05.349950 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65f59f7b-a7a8-4a64-a143-74d99c88337c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:05.350402 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65f59f7b-a7a8-4a64-a143-74d99c88337c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:05.351200 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65f59f7b-a7a8-4a64-a143-74d99c88337c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:05.352779 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65f59f7b-a7a8-4a64-a143-74d99c88337c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:05.547612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-65f59f7b-a7a8-4a64-a143-74d99c88337c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:05.556790 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-65f59f7b-a7a8-4a64-a143-74d99c88337c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:05.558351 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-65f59f7b-a7a8-4a64-a143-74d99c88337c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:05.559938 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-65f59f7b-a7a8-4a64-a143-74d99c88337c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.225144 Nov 23 04:17:05.560658 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 248/434] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:05 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:05.879449 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ff77ff4b-a1e6-4115-9dd7-560d1d0b03c3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/action" status: 200 len: 32 microversion: 2.1 time: 0.978357 Nov 23 04:17:05.883625 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 187/435] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:17:04 2021] POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/action => generated 32 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:17:05.890626 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-76e859a6-b7a0-429e-a3ba-d94b00a9fcea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:05.891352 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-76e859a6-b7a0-429e-a3ba-d94b00a9fcea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:05.897258 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76e859a6-b7a0-429e-a3ba-d94b00a9fcea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:05.897744 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76e859a6-b7a0-429e-a3ba-d94b00a9fcea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:05.899182 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76e859a6-b7a0-429e-a3ba-d94b00a9fcea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:05.900882 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76e859a6-b7a0-429e-a3ba-d94b00a9fcea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:06.354010 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fec041c1-d84e-4e03-bf66-aca5fe8281f7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:06.355467 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fec041c1-d84e-4e03-bf66-aca5fe8281f7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:06.369250 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fec041c1-d84e-4e03-bf66-aca5fe8281f7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:06.373466 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fec041c1-d84e-4e03-bf66-aca5fe8281f7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:06.374688 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fec041c1-d84e-4e03-bf66-aca5fe8281f7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:06.375523 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fec041c1-d84e-4e03-bf66-aca5fe8281f7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:06.546075 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-76e859a6-b7a0-429e-a3ba-d94b00a9fcea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:06.565591 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-76e859a6-b7a0-429e-a3ba-d94b00a9fcea tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.676814 Nov 23 04:17:06.566879 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 249/436] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:05 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:06.581595 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-699ede52-7a5c-472e-adfc-df2b93421f99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:06.582351 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-699ede52-7a5c-472e-adfc-df2b93421f99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:06.594807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-699ede52-7a5c-472e-adfc-df2b93421f99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:06.594807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-699ede52-7a5c-472e-adfc-df2b93421f99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:06.594807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-699ede52-7a5c-472e-adfc-df2b93421f99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:06.594807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-699ede52-7a5c-472e-adfc-df2b93421f99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:07.137350 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-699ede52-7a5c-472e-adfc-df2b93421f99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:07.145706 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-699ede52-7a5c-472e-adfc-df2b93421f99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:07.152991 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-699ede52-7a5c-472e-adfc-df2b93421f99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:07.157767 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-699ede52-7a5c-472e-adfc-df2b93421f99 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.579720 Nov 23 04:17:07.178296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 250/437] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:06 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:07.234408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fec041c1-d84e-4e03-bf66-aca5fe8281f7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:07.247710 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fec041c1-d84e-4e03-bf66-aca5fe8281f7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1318 microversion: 2.1 time: 0.905181 Nov 23 04:17:07.257689 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 188/438] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:06 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1318 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:07.592795 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-63fd7a27-f892-4078-8ae4-39178997c3e1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:07.594067 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-63fd7a27-f892-4078-8ae4-39178997c3e1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:07.601120 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-63fd7a27-f892-4078-8ae4-39178997c3e1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:07.602502 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-63fd7a27-f892-4078-8ae4-39178997c3e1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:07.603927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-63fd7a27-f892-4078-8ae4-39178997c3e1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:07.604535 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-63fd7a27-f892-4078-8ae4-39178997c3e1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:08.187542 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3bd55ea4-1165-4d8d-801c-9aef6a7a4890 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:08.192698 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3bd55ea4-1165-4d8d-801c-9aef6a7a4890 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:08.210175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3bd55ea4-1165-4d8d-801c-9aef6a7a4890 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:08.213416 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3bd55ea4-1165-4d8d-801c-9aef6a7a4890 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:08.214836 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3bd55ea4-1165-4d8d-801c-9aef6a7a4890 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:08.217104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3bd55ea4-1165-4d8d-801c-9aef6a7a4890 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:08.265958 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-63fd7a27-f892-4078-8ae4-39178997c3e1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:08.279660 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-63fd7a27-f892-4078-8ae4-39178997c3e1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.692775 Nov 23 04:17:08.288750 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 251/439] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:07 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:08.288750 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f7a0d014-a751-4ad8-9a46-4f334513cf0b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:08.288750 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f7a0d014-a751-4ad8-9a46-4f334513cf0b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:08.308624 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f7a0d014-a751-4ad8-9a46-4f334513cf0b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:08.328905 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f7a0d014-a751-4ad8-9a46-4f334513cf0b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:08.330134 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f7a0d014-a751-4ad8-9a46-4f334513cf0b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:08.333248 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f7a0d014-a751-4ad8-9a46-4f334513cf0b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:08.551587 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3bd55ea4-1165-4d8d-801c-9aef6a7a4890 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:08.575129 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3bd55ea4-1165-4d8d-801c-9aef6a7a4890 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:08.579262 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3bd55ea4-1165-4d8d-801c-9aef6a7a4890 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:08.584358 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3bd55ea4-1165-4d8d-801c-9aef6a7a4890 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.401267 Nov 23 04:17:08.592294 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 189/440] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:08 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:08.664444 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f7a0d014-a751-4ad8-9a46-4f334513cf0b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:08.673911 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f7a0d014-a751-4ad8-9a46-4f334513cf0b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1318 microversion: 2.1 time: 0.392004 Nov 23 04:17:08.685135 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 252/441] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:08 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:09.301925 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e43efcdd-093c-49aa-89de-fac42289e102 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:09.301925 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e43efcdd-093c-49aa-89de-fac42289e102 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:09.309582 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-c551fda7-7b97-41e8-9141-c238c9e40d78 req-ff872b09-43af-4707-9292-52a608a3421d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5694f710-d745-44e4-9b59-55d54a09515d", "name": "network-vif-plugged", "status": "completed", "tag": "17ac3a98-501a-42f8-b6c9-52d0039362e2"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:09.311978 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:17:09.311978 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:17:09.330140 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e43efcdd-093c-49aa-89de-fac42289e102 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:09.340013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e43efcdd-093c-49aa-89de-fac42289e102 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:09.340013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e43efcdd-093c-49aa-89de-fac42289e102 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:09.340013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e43efcdd-093c-49aa-89de-fac42289e102 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:09.340562 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-c551fda7-7b97-41e8-9141-c238c9e40d78 req-ff872b09-43af-4707-9292-52a608a3421d service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:09.340562 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-c551fda7-7b97-41e8-9141-c238c9e40d78 req-ff872b09-43af-4707-9292-52a608a3421d service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:09.369897 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-c551fda7-7b97-41e8-9141-c238c9e40d78 req-ff872b09-43af-4707-9292-52a608a3421d service nova] Creating event network-vif-plugged:17ac3a98-501a-42f8-b6c9-52d0039362e2 for instance 5694f710-d745-44e4-9b59-55d54a09515d on hv-cinder-76845 Nov 23 04:17:09.380195 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-c551fda7-7b97-41e8-9141-c238c9e40d78 req-ff872b09-43af-4707-9292-52a608a3421d service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074881 Nov 23 04:17:09.385187 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 253/442] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:17:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:09.600046 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e43efcdd-093c-49aa-89de-fac42289e102 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:09.610696 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-554f9372-68e2-48f9-a182-a44e87d366c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:09.611711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-554f9372-68e2-48f9-a182-a44e87d366c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:09.621212 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e43efcdd-093c-49aa-89de-fac42289e102 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.327108 Nov 23 04:17:09.631332 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-554f9372-68e2-48f9-a182-a44e87d366c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:09.632131 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-554f9372-68e2-48f9-a182-a44e87d366c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:09.632526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 190/443] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:09 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:09.634346 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-554f9372-68e2-48f9-a182-a44e87d366c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:09.636851 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-554f9372-68e2-48f9-a182-a44e87d366c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:09.691920 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0fd2a4ba-70b2-4cd7-a7a8-4ebe5d388f50 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:09.693365 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0fd2a4ba-70b2-4cd7-a7a8-4ebe5d388f50 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:09.700518 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0fd2a4ba-70b2-4cd7-a7a8-4ebe5d388f50 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:09.701247 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0fd2a4ba-70b2-4cd7-a7a8-4ebe5d388f50 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:09.703801 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0fd2a4ba-70b2-4cd7-a7a8-4ebe5d388f50 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:09.707784 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0fd2a4ba-70b2-4cd7-a7a8-4ebe5d388f50 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:10.130042 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-554f9372-68e2-48f9-a182-a44e87d366c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:10.140564 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-554f9372-68e2-48f9-a182-a44e87d366c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:10.160710 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-554f9372-68e2-48f9-a182-a44e87d366c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:10.165478 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-554f9372-68e2-48f9-a182-a44e87d366c5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.558646 Nov 23 04:17:10.181447 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 254/444] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:09 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:10.231912 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0fd2a4ba-70b2-4cd7-a7a8-4ebe5d388f50 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:10.240586 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0fd2a4ba-70b2-4cd7-a7a8-4ebe5d388f50 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1318 microversion: 2.1 time: 0.552186 Nov 23 04:17:10.253233 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 191/445] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:09 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:10.648088 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4a878ab4-1fe8-4940-8d79-621232d829ca tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:10.653260 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4a878ab4-1fe8-4940-8d79-621232d829ca tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:10.662237 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4a878ab4-1fe8-4940-8d79-621232d829ca tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:10.663110 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4a878ab4-1fe8-4940-8d79-621232d829ca tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:10.665581 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4a878ab4-1fe8-4940-8d79-621232d829ca tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:10.666371 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4a878ab4-1fe8-4940-8d79-621232d829ca tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:10.922557 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4a878ab4-1fe8-4940-8d79-621232d829ca tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:10.933807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4a878ab4-1fe8-4940-8d79-621232d829ca tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.290836 Nov 23 04:17:10.985901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 255/446] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:10 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:11.187275 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1e1ff4c5-690b-4bc2-8b95-5bc75258e25a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:11.187951 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1e1ff4c5-690b-4bc2-8b95-5bc75258e25a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:11.196192 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e1ff4c5-690b-4bc2-8b95-5bc75258e25a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:11.196192 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e1ff4c5-690b-4bc2-8b95-5bc75258e25a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:11.197140 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e1ff4c5-690b-4bc2-8b95-5bc75258e25a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:11.197977 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1e1ff4c5-690b-4bc2-8b95-5bc75258e25a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:11.264982 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4e01b9a3-7dc2-4c66-828b-145c2068e151 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:11.264982 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4e01b9a3-7dc2-4c66-828b-145c2068e151 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:11.267828 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e01b9a3-7dc2-4c66-828b-145c2068e151 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:11.269697 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e01b9a3-7dc2-4c66-828b-145c2068e151 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:11.270904 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e01b9a3-7dc2-4c66-828b-145c2068e151 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:11.271375 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e01b9a3-7dc2-4c66-828b-145c2068e151 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:11.529671 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1e1ff4c5-690b-4bc2-8b95-5bc75258e25a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:11.550703 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4e01b9a3-7dc2-4c66-828b-145c2068e151 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:11.551866 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1e1ff4c5-690b-4bc2-8b95-5bc75258e25a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:11.554492 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1e1ff4c5-690b-4bc2-8b95-5bc75258e25a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:11.562027 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1e1ff4c5-690b-4bc2-8b95-5bc75258e25a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.378288 Nov 23 04:17:11.574785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 192/447] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:11 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:11.575006 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4e01b9a3-7dc2-4c66-828b-145c2068e151 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1318 microversion: 2.1 time: 0.309692 Nov 23 04:17:11.587653 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 256/448] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:11 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:12.000470 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bddd61ff-f651-48c5-b4f1-985ee62d73af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:12.001366 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-bddd61ff-f651-48c5-b4f1-985ee62d73af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:12.010544 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bddd61ff-f651-48c5-b4f1-985ee62d73af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:12.011444 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bddd61ff-f651-48c5-b4f1-985ee62d73af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:12.013779 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bddd61ff-f651-48c5-b4f1-985ee62d73af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:12.014149 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bddd61ff-f651-48c5-b4f1-985ee62d73af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:12.322194 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bddd61ff-f651-48c5-b4f1-985ee62d73af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:12.339021 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bddd61ff-f651-48c5-b4f1-985ee62d73af tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.340017 Nov 23 04:17:12.349655 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 193/449] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:11 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:12.582898 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4e40bdec-1918-4079-bdfe-bb33762752d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:12.585405 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4e40bdec-1918-4079-bdfe-bb33762752d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:12.585952 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-756421e2-449c-4b27-9bc6-dc86982b9ac3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:12.586811 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-756421e2-449c-4b27-9bc6-dc86982b9ac3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:12.594067 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e40bdec-1918-4079-bdfe-bb33762752d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:12.594776 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e40bdec-1918-4079-bdfe-bb33762752d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:12.595923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e40bdec-1918-4079-bdfe-bb33762752d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:12.596104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-756421e2-449c-4b27-9bc6-dc86982b9ac3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:12.596653 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-756421e2-449c-4b27-9bc6-dc86982b9ac3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:12.596813 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e40bdec-1918-4079-bdfe-bb33762752d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:12.599578 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-756421e2-449c-4b27-9bc6-dc86982b9ac3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:12.600757 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-756421e2-449c-4b27-9bc6-dc86982b9ac3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:13.282297 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-756421e2-449c-4b27-9bc6-dc86982b9ac3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:13.290163 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4e40bdec-1918-4079-bdfe-bb33762752d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:13.295187 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-756421e2-449c-4b27-9bc6-dc86982b9ac3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1508 microversion: 2.1 time: 0.713099 Nov 23 04:17:13.301542 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 194/450] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:12 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1508 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:13.324204 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4e40bdec-1918-4079-bdfe-bb33762752d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:13.338512 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4e40bdec-1918-4079-bdfe-bb33762752d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:13.348581 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4e40bdec-1918-4079-bdfe-bb33762752d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.770390 Nov 23 04:17:13.351610 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 257/451] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:12 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:13.356742 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b0dfef36-d199-4e0d-8acd-7503867126c8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:13.357888 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b0dfef36-d199-4e0d-8acd-7503867126c8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:13.364205 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b0dfef36-d199-4e0d-8acd-7503867126c8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:13.380026 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b0dfef36-d199-4e0d-8acd-7503867126c8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:13.381232 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b0dfef36-d199-4e0d-8acd-7503867126c8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:13.381824 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b0dfef36-d199-4e0d-8acd-7503867126c8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:13.649575 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-b0dfef36-d199-4e0d-8acd-7503867126c8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:13.667306 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b0dfef36-d199-4e0d-8acd-7503867126c8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.313853 Nov 23 04:17:13.671274 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 195/452] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:13 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:14.370247 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-23f0cb32-82b5-4fc2-99db-e6fde9a4bd04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:14.370827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-23f0cb32-82b5-4fc2-99db-e6fde9a4bd04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:14.376827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-23f0cb32-82b5-4fc2-99db-e6fde9a4bd04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:14.377337 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-23f0cb32-82b5-4fc2-99db-e6fde9a4bd04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:14.378201 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-23f0cb32-82b5-4fc2-99db-e6fde9a4bd04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:14.378920 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-23f0cb32-82b5-4fc2-99db-e6fde9a4bd04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:14.689336 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9190a3a1-0536-4990-9298-16bf0be3b8d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:14.690489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9190a3a1-0536-4990-9298-16bf0be3b8d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:14.700469 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9190a3a1-0536-4990-9298-16bf0be3b8d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:14.701617 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9190a3a1-0536-4990-9298-16bf0be3b8d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:14.702384 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9190a3a1-0536-4990-9298-16bf0be3b8d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:14.708809 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9190a3a1-0536-4990-9298-16bf0be3b8d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:14.747483 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-23f0cb32-82b5-4fc2-99db-e6fde9a4bd04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:14.756286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-23f0cb32-82b5-4fc2-99db-e6fde9a4bd04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:14.757813 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-23f0cb32-82b5-4fc2-99db-e6fde9a4bd04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:14.771489 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-23f0cb32-82b5-4fc2-99db-e6fde9a4bd04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.393680 Nov 23 04:17:14.774176 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 258/453] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:14 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:14.921940 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9190a3a1-0536-4990-9298-16bf0be3b8d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:14.932052 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9190a3a1-0536-4990-9298-16bf0be3b8d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.249251 Nov 23 04:17:14.933290 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 196/454] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:14 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:15.420998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bbdc33d0-7446-4178-ae81-61457b4bd907 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81b19d18-0f46-4c2f-89f5-7fbd146fad0e"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:15.422256 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bbdc33d0-7446-4178-ae81-61457b4bd907 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:15.431685 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bbdc33d0-7446-4178-ae81-61457b4bd907 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:15.432136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bbdc33d0-7446-4178-ae81-61457b4bd907 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:15.432920 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bbdc33d0-7446-4178-ae81-61457b4bd907 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:15.433370 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bbdc33d0-7446-4178-ae81-61457b4bd907 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:15.798981 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-026779ce-a487-4494-a27b-b36f55af1f16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:15.800607 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-026779ce-a487-4494-a27b-b36f55af1f16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:15.808455 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-026779ce-a487-4494-a27b-b36f55af1f16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:15.809153 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-026779ce-a487-4494-a27b-b36f55af1f16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:15.810165 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-026779ce-a487-4494-a27b-b36f55af1f16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:15.810639 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-026779ce-a487-4494-a27b-b36f55af1f16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:16.255658 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-026779ce-a487-4494-a27b-b36f55af1f16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:16.274921 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-026779ce-a487-4494-a27b-b36f55af1f16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:16.277500 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-026779ce-a487-4494-a27b-b36f55af1f16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:16.284283 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-026779ce-a487-4494-a27b-b36f55af1f16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.496044 Nov 23 04:17:16.300592 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 197/455] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:15 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:16.312590 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e81f2529-ec6f-4b9d-95ad-8bef07e22f0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:16.313644 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e81f2529-ec6f-4b9d-95ad-8bef07e22f0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:16.327562 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e81f2529-ec6f-4b9d-95ad-8bef07e22f0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:16.329241 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e81f2529-ec6f-4b9d-95ad-8bef07e22f0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:16.330361 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e81f2529-ec6f-4b9d-95ad-8bef07e22f0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:16.331848 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e81f2529-ec6f-4b9d-95ad-8bef07e22f0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:16.573902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e81f2529-ec6f-4b9d-95ad-8bef07e22f0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:16.585473 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e81f2529-ec6f-4b9d-95ad-8bef07e22f0c tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.283386 Nov 23 04:17:16.586626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 198/456] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:16 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:17.303656 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-669cdc9e-035e-49b6-bc58-b353466b7820 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:17.304352 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-669cdc9e-035e-49b6-bc58-b353466b7820 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:17.310769 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-669cdc9e-035e-49b6-bc58-b353466b7820 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:17.311233 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-669cdc9e-035e-49b6-bc58-b353466b7820 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:17.312064 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-669cdc9e-035e-49b6-bc58-b353466b7820 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:17.312506 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-669cdc9e-035e-49b6-bc58-b353466b7820 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:17.546323 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bbdc33d0-7446-4178-ae81-61457b4bd907 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "POST /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.132714 Nov 23 04:17:17.548214 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 259/457] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:17:15 2021] POST /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d/os-volume_attachments => generated 194 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:17.599355 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-669cdc9e-035e-49b6-bc58-b353466b7820 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:17.606586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f577c983-12aa-4d52-9e46-e15f90de1c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:17.607645 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f577c983-12aa-4d52-9e46-e15f90de1c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:17.614882 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-669cdc9e-035e-49b6-bc58-b353466b7820 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:17.621577 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f577c983-12aa-4d52-9e46-e15f90de1c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:17.623647 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f577c983-12aa-4d52-9e46-e15f90de1c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:17.625325 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f577c983-12aa-4d52-9e46-e15f90de1c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:17.625905 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-669cdc9e-035e-49b6-bc58-b353466b7820 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:17.630786 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-669cdc9e-035e-49b6-bc58-b353466b7820 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.330078 Nov 23 04:17:17.633517 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f577c983-12aa-4d52-9e46-e15f90de1c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:17.646165 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 199/458] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:17 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:17.876643 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f577c983-12aa-4d52-9e46-e15f90de1c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:17.887034 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f577c983-12aa-4d52-9e46-e15f90de1c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.286412 Nov 23 04:17:17.888168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 260/459] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:17 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:18.650204 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9049fc7c-d064-46d3-bebf-3c3c013dfcf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:18.650946 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9049fc7c-d064-46d3-bebf-3c3c013dfcf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:18.657946 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9049fc7c-d064-46d3-bebf-3c3c013dfcf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:18.660150 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9049fc7c-d064-46d3-bebf-3c3c013dfcf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:18.660150 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9049fc7c-d064-46d3-bebf-3c3c013dfcf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:18.660150 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9049fc7c-d064-46d3-bebf-3c3c013dfcf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:18.812556 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9049fc7c-d064-46d3-bebf-3c3c013dfcf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:18.820923 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9049fc7c-d064-46d3-bebf-3c3c013dfcf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:18.822435 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9049fc7c-d064-46d3-bebf-3c3c013dfcf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:18.823809 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9049fc7c-d064-46d3-bebf-3c3c013dfcf2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.177768 Nov 23 04:17:18.824371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 200/460] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:18 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:18.905361 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a36875b4-0f08-4e6c-bbd6-de467d895a60 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:18.906048 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a36875b4-0f08-4e6c-bbd6-de467d895a60 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:18.912400 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a36875b4-0f08-4e6c-bbd6-de467d895a60 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:18.912849 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a36875b4-0f08-4e6c-bbd6-de467d895a60 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:18.913666 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a36875b4-0f08-4e6c-bbd6-de467d895a60 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:18.914901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a36875b4-0f08-4e6c-bbd6-de467d895a60 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:19.191062 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a36875b4-0f08-4e6c-bbd6-de467d895a60 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:19.201039 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a36875b4-0f08-4e6c-bbd6-de467d895a60 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.299307 Nov 23 04:17:19.206387 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 261/461] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:18 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:19.842972 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fcca15a4-4ab4-46c6-8b3a-f92892b05518 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:19.843538 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fcca15a4-4ab4-46c6-8b3a-f92892b05518 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:19.859865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fcca15a4-4ab4-46c6-8b3a-f92892b05518 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:19.860672 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fcca15a4-4ab4-46c6-8b3a-f92892b05518 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:19.862165 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fcca15a4-4ab4-46c6-8b3a-f92892b05518 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:19.863243 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fcca15a4-4ab4-46c6-8b3a-f92892b05518 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:20.027268 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fcca15a4-4ab4-46c6-8b3a-f92892b05518 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:20.039820 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fcca15a4-4ab4-46c6-8b3a-f92892b05518 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:20.041322 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fcca15a4-4ab4-46c6-8b3a-f92892b05518 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:20.042497 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fcca15a4-4ab4-46c6-8b3a-f92892b05518 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1735 microversion: 2.20 time: 0.203334 Nov 23 04:17:20.043119 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 201/462] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:19 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:20.227709 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1f6072e3-daf8-4c3e-ae80-ce9255ff83ff tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:20.228474 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1f6072e3-daf8-4c3e-ae80-ce9255ff83ff tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:20.235326 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1f6072e3-daf8-4c3e-ae80-ce9255ff83ff tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:20.235973 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1f6072e3-daf8-4c3e-ae80-ce9255ff83ff tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:20.238179 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1f6072e3-daf8-4c3e-ae80-ce9255ff83ff tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:20.238866 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1f6072e3-daf8-4c3e-ae80-ce9255ff83ff tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:20.427719 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-497238240", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "networks": [{"uuid": "a4af6b2e-6f38-4592-bab5-e9082b904a73"}]}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:20.514830 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.network.neutron [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] validate_networks() for [('a4af6b2e-6f38-4592-bab5-e9082b904a73', None, None, None, None, None)] {{(pid=116837) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:17:20.630972 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1f6072e3-daf8-4c3e-ae80-ce9255ff83ff tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:20.641094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1f6072e3-daf8-4c3e-ae80-ce9255ff83ff tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.419754 Nov 23 04:17:20.641672 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 262/463] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:20 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:21.060707 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-86eadd17-5f4a-4fd3-b1a0-50ac903f60cb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:21.061618 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-86eadd17-5f4a-4fd3-b1a0-50ac903f60cb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:21.067787 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-86eadd17-5f4a-4fd3-b1a0-50ac903f60cb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:21.068551 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-86eadd17-5f4a-4fd3-b1a0-50ac903f60cb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:21.069654 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-86eadd17-5f4a-4fd3-b1a0-50ac903f60cb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:21.070926 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-86eadd17-5f4a-4fd3-b1a0-50ac903f60cb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:21.452181 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Flavor limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:17:21.453174 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Image limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:17:21.453819 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Flavor pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:17:21.454393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Image pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:17:21.454982 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:17:21.487954 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:21.488878 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:21.489703 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:21.490338 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:21.523756 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Getting quotas for project 78807cb7ca9445b38b7e896adc10ec2b. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:17:21.524635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-86eadd17-5f4a-4fd3-b1a0-50ac903f60cb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:21.528772 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Getting quotas for user b20ce08f5765442dbdf399983b8df856 and project 78807cb7ca9445b38b7e896adc10ec2b. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:17:21.533031 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-86eadd17-5f4a-4fd3-b1a0-50ac903f60cb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:21.534655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-86eadd17-5f4a-4fd3-b1a0-50ac903f60cb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:21.535998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-86eadd17-5f4a-4fd3-b1a0-50ac903f60cb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1717 microversion: 2.20 time: 0.478904 Nov 23 04:17:21.536974 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 263/464] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:21 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1717 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:21.553079 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Going to run 1 instances... {{(pid=116837) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:17:21.556199 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:17:21.659029 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-da0e61e5-7922-4a33-bd92-9bc12760bb96 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:21.660073 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-da0e61e5-7922-4a33-bd92-9bc12760bb96 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:21.668426 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-da0e61e5-7922-4a33-bd92-9bc12760bb96 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:21.673329 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-da0e61e5-7922-4a33-bd92-9bc12760bb96 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:21.673329 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-da0e61e5-7922-4a33-bd92-9bc12760bb96 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:21.673329 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-da0e61e5-7922-4a33-bd92-9bc12760bb96 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:21.674367 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-334696de-cb54-4eed-b91f-a63321da8a74 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.250498 Nov 23 04:17:21.684926 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 202/465] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:17:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 04:17:21.694515 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-95abd6ea-a849-44eb-8d02-832e4a2fe8c8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:21.696000 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-95abd6ea-a849-44eb-8d02-832e4a2fe8c8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:21.784054 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-95abd6ea-a849-44eb-8d02-832e4a2fe8c8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:21.793716 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-95abd6ea-a849-44eb-8d02-832e4a2fe8c8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1213 microversion: 2.1 time: 0.103090 Nov 23 04:17:21.794596 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 203/466] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:21 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:21.895620 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-da0e61e5-7922-4a33-bd92-9bc12760bb96 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:21.906488 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-da0e61e5-7922-4a33-bd92-9bc12760bb96 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.251110 Nov 23 04:17:21.908637 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 264/467] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:21 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:22.578861 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-392dc682-aa62-458a-896f-1ef41af1907a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:22.581033 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-392dc682-aa62-458a-896f-1ef41af1907a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:22.593071 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-392dc682-aa62-458a-896f-1ef41af1907a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:22.593560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-392dc682-aa62-458a-896f-1ef41af1907a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:22.594568 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-392dc682-aa62-458a-896f-1ef41af1907a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:22.595037 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-392dc682-aa62-458a-896f-1ef41af1907a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:22.811327 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ec0a097d-4df8-4903-a7e1-20d651b278d1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:22.812605 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ec0a097d-4df8-4903-a7e1-20d651b278d1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:22.910264 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ec0a097d-4df8-4903-a7e1-20d651b278d1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:22.919305 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ec0a097d-4df8-4903-a7e1-20d651b278d1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1213 microversion: 2.1 time: 0.112766 Nov 23 04:17:22.931064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 265/468] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:22 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:22.936548 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6e0a4ab3-7ee3-402f-9f08-a6244714763f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:22.937413 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6e0a4ab3-7ee3-402f-9f08-a6244714763f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:22.944268 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e0a4ab3-7ee3-402f-9f08-a6244714763f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:22.946530 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e0a4ab3-7ee3-402f-9f08-a6244714763f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:22.947595 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e0a4ab3-7ee3-402f-9f08-a6244714763f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:22.948245 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e0a4ab3-7ee3-402f-9f08-a6244714763f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:22.957445 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-392dc682-aa62-458a-896f-1ef41af1907a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:22.965412 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-392dc682-aa62-458a-896f-1ef41af1907a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:22.966973 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-392dc682-aa62-458a-896f-1ef41af1907a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:22.968161 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-392dc682-aa62-458a-896f-1ef41af1907a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1717 microversion: 2.20 time: 0.403018 Nov 23 04:17:22.968716 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 204/469] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:22 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1717 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:23.204583 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6e0a4ab3-7ee3-402f-9f08-a6244714763f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:23.211655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6e0a4ab3-7ee3-402f-9f08-a6244714763f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.278956 Nov 23 04:17:23.212471 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 266/470] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:22 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:23.937578 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a1bd2056-7a48-4159-9313-6a3d9aeec2bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:23.938403 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a1bd2056-7a48-4159-9313-6a3d9aeec2bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:23.945175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a1bd2056-7a48-4159-9313-6a3d9aeec2bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:23.946067 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a1bd2056-7a48-4159-9313-6a3d9aeec2bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:23.947064 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a1bd2056-7a48-4159-9313-6a3d9aeec2bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:23.947701 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a1bd2056-7a48-4159-9313-6a3d9aeec2bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:23.986805 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8fc4b2b8-fe8b-4f26-8156-7b65a0e5f189 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:23.988216 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8fc4b2b8-fe8b-4f26-8156-7b65a0e5f189 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:23.999797 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8fc4b2b8-fe8b-4f26-8156-7b65a0e5f189 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:24.004357 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8fc4b2b8-fe8b-4f26-8156-7b65a0e5f189 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:24.005012 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8fc4b2b8-fe8b-4f26-8156-7b65a0e5f189 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:24.008287 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8fc4b2b8-fe8b-4f26-8156-7b65a0e5f189 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:24.021442 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a1bd2056-7a48-4159-9313-6a3d9aeec2bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:24.034536 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a1bd2056-7a48-4159-9313-6a3d9aeec2bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1209 microversion: 2.1 time: 0.096092 Nov 23 04:17:24.035842 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 205/471] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:23 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:24.168280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8fc4b2b8-fe8b-4f26-8156-7b65a0e5f189 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:24.177035 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8fc4b2b8-fe8b-4f26-8156-7b65a0e5f189 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:24.181552 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8fc4b2b8-fe8b-4f26-8156-7b65a0e5f189 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:24.182734 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8fc4b2b8-fe8b-4f26-8156-7b65a0e5f189 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1720 microversion: 2.20 time: 0.199787 Nov 23 04:17:24.183374 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 267/472] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:23 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:24.200498 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0f7a1b9a-16dd-471a-b637-a25df2ed6bdf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c3f8116-d706-4a0d-b06d-ba141d1660fe"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:24.202212 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0f7a1b9a-16dd-471a-b637-a25df2ed6bdf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:24.208305 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f7a1b9a-16dd-471a-b637-a25df2ed6bdf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:24.208995 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f7a1b9a-16dd-471a-b637-a25df2ed6bdf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:24.209989 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f7a1b9a-16dd-471a-b637-a25df2ed6bdf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:24.210697 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f7a1b9a-16dd-471a-b637-a25df2ed6bdf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:24.229919 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5a24495a-a695-40e5-99c3-90c44cfb8ed8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:24.231065 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5a24495a-a695-40e5-99c3-90c44cfb8ed8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:24.237801 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5a24495a-a695-40e5-99c3-90c44cfb8ed8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:24.238573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5a24495a-a695-40e5-99c3-90c44cfb8ed8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:24.239704 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5a24495a-a695-40e5-99c3-90c44cfb8ed8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:24.240568 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5a24495a-a695-40e5-99c3-90c44cfb8ed8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:24.447743 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5a24495a-a695-40e5-99c3-90c44cfb8ed8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:24.455650 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5a24495a-a695-40e5-99c3-90c44cfb8ed8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.229801 Nov 23 04:17:24.460423 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 268/473] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:24 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:25.052989 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-01e78177-78ec-4b13-90e9-592cc20ae8bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:25.053732 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-01e78177-78ec-4b13-90e9-592cc20ae8bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:25.063544 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01e78177-78ec-4b13-90e9-592cc20ae8bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:25.066615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01e78177-78ec-4b13-90e9-592cc20ae8bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:25.067480 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01e78177-78ec-4b13-90e9-592cc20ae8bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:25.067932 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01e78177-78ec-4b13-90e9-592cc20ae8bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:25.163552 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-01e78177-78ec-4b13-90e9-592cc20ae8bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:25.172064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-01e78177-78ec-4b13-90e9-592cc20ae8bb tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1265 microversion: 2.1 time: 0.122960 Nov 23 04:17:25.172739 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 269/474] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:25 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:25.177067 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-cb298ec5-4951-41ac-b3fc-0b588f25b59f req-9f484d16-6aa1-434d-b0a0-5c16d8a4f976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c13d4db-587d-4d4e-b8cc-23632d768572", "name": "network-vif-unplugged", "status": "completed", "tag": "1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:25.180252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:17:25.180252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:17:25.204001 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-cb298ec5-4951-41ac-b3fc-0b588f25b59f req-9f484d16-6aa1-434d-b0a0-5c16d8a4f976 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:25.210264 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-cb298ec5-4951-41ac-b3fc-0b588f25b59f req-9f484d16-6aa1-434d-b0a0-5c16d8a4f976 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:25.222058 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.compute.server_external_events [req-cb298ec5-4951-41ac-b3fc-0b588f25b59f req-9f484d16-6aa1-434d-b0a0-5c16d8a4f976 service nova] Unable to find a host for instance 8c13d4db-587d-4d4e-b8cc-23632d768572. Dropping event network-vif-unplugged {{(pid=116836) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 23 04:17:25.222962 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-cb298ec5-4951-41ac-b3fc-0b588f25b59f req-9f484d16-6aa1-434d-b0a0-5c16d8a4f976 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049330 Nov 23 04:17:25.224778 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 270/475] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:17:25 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 23 04:17:25.474930 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3c3ba0b0-2b2a-485e-aac8-af2612fa82e3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:25.475906 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3c3ba0b0-2b2a-485e-aac8-af2612fa82e3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:25.496469 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c3ba0b0-2b2a-485e-aac8-af2612fa82e3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:25.497161 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c3ba0b0-2b2a-485e-aac8-af2612fa82e3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:25.499973 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c3ba0b0-2b2a-485e-aac8-af2612fa82e3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:25.501967 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c3ba0b0-2b2a-485e-aac8-af2612fa82e3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:25.517436 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0f7a1b9a-16dd-471a-b637-a25df2ed6bdf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.319198 Nov 23 04:17:25.517436 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 206/476] 10.222.0.54 () {62 vars in 1363 bytes} [Tue Nov 23 04:17:24 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments => generated 188 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:17:25.827767 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-86fe74a4-8711-4e19-9c99-0a8e8ae7680b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:25.828620 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-86fe74a4-8711-4e19-9c99-0a8e8ae7680b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:25.841031 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-86fe74a4-8711-4e19-9c99-0a8e8ae7680b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:25.841734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-86fe74a4-8711-4e19-9c99-0a8e8ae7680b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:25.842732 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-86fe74a4-8711-4e19-9c99-0a8e8ae7680b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:25.843561 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-86fe74a4-8711-4e19-9c99-0a8e8ae7680b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:25.880603 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3c3ba0b0-2b2a-485e-aac8-af2612fa82e3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:25.893923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3c3ba0b0-2b2a-485e-aac8-af2612fa82e3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.424550 Nov 23 04:17:25.895999 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 271/477] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:25 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:26.170946 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-86fe74a4-8711-4e19-9c99-0a8e8ae7680b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action" status: 202 len: 0 microversion: 2.20 time: 0.347222 Nov 23 04:17:26.180883 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5d82986e-b66c-4830-b3d9-1638b76467bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:26.182107 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5d82986e-b66c-4830-b3d9-1638b76467bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:26.191526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 207/478] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:17:25 2021] POST /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:17:26.201337 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8fd39fc0-38f4-45fb-9573-6674e6bda246 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:26.201957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8fd39fc0-38f4-45fb-9573-6674e6bda246 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:26.204243 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5d82986e-b66c-4830-b3d9-1638b76467bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:26.204753 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5d82986e-b66c-4830-b3d9-1638b76467bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:26.205572 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5d82986e-b66c-4830-b3d9-1638b76467bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:26.206010 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5d82986e-b66c-4830-b3d9-1638b76467bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:26.231340 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8fd39fc0-38f4-45fb-9573-6674e6bda246 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:26.231950 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8fd39fc0-38f4-45fb-9573-6674e6bda246 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:26.232701 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8fd39fc0-38f4-45fb-9573-6674e6bda246 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:26.248435 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8fd39fc0-38f4-45fb-9573-6674e6bda246 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:26.360609 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8fd39fc0-38f4-45fb-9573-6674e6bda246 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:26.369495 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8fd39fc0-38f4-45fb-9573-6674e6bda246 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1271 microversion: 2.1 time: 0.176845 Nov 23 04:17:26.373857 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 208/479] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:26 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:26.590697 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5d82986e-b66c-4830-b3d9-1638b76467bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:26.614028 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5d82986e-b66c-4830-b3d9-1638b76467bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:26.625223 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5d82986e-b66c-4830-b3d9-1638b76467bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:26.638164 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5d82986e-b66c-4830-b3d9-1638b76467bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1746 microversion: 2.20 time: 0.461678 Nov 23 04:17:26.647229 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 272/480] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:26 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1746 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:26.912768 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-89e69349-94e8-4505-ba83-064481c01d6e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:26.913978 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-89e69349-94e8-4505-ba83-064481c01d6e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:26.919064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6710b207-f4bb-4fce-aba1-34e94b092c70 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:26.919596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6710b207-f4bb-4fce-aba1-34e94b092c70 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:26.925355 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6710b207-f4bb-4fce-aba1-34e94b092c70 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:26.925514 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-89e69349-94e8-4505-ba83-064481c01d6e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:26.925803 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6710b207-f4bb-4fce-aba1-34e94b092c70 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:26.926130 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-89e69349-94e8-4505-ba83-064481c01d6e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:26.926582 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6710b207-f4bb-4fce-aba1-34e94b092c70 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:26.927019 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6710b207-f4bb-4fce-aba1-34e94b092c70 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:26.927121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-89e69349-94e8-4505-ba83-064481c01d6e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:26.927607 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-89e69349-94e8-4505-ba83-064481c01d6e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:27.007068 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-6710b207-f4bb-4fce-aba1-34e94b092c70 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lazy-loading 'services' on Instance uuid 5694f710-d745-44e4-9b59-55d54a09515d {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:17:27.096366 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-89e69349-94e8-4505-ba83-064481c01d6e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:27.105402 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-89e69349-94e8-4505-ba83-064481c01d6e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.196548 Nov 23 04:17:27.105968 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 209/481] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:26 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:27.393645 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-53a19da5-0b86-4f72-957c-be8b2c8ea962 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:27.396364 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-53a19da5-0b86-4f72-957c-be8b2c8ea962 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:27.403591 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-53a19da5-0b86-4f72-957c-be8b2c8ea962 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:27.404830 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-53a19da5-0b86-4f72-957c-be8b2c8ea962 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:27.405973 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-53a19da5-0b86-4f72-957c-be8b2c8ea962 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:27.406652 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-53a19da5-0b86-4f72-957c-be8b2c8ea962 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:27.466068 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6710b207-f4bb-4fce-aba1-34e94b092c70 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "DELETE /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d/os-volume_attachments/81b19d18-0f46-4c2f-89f5-7fbd146fad0e" status: 202 len: 0 microversion: 2.1 time: 0.550428 Nov 23 04:17:27.475799 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 273/482] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:17:26 2021] DELETE /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d/os-volume_attachments/81b19d18-0f46-4c2f-89f5-7fbd146fad0e => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:17:27.489398 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-58c564a8-79b6-468c-982d-b677897a2cb3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:27.490474 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-58c564a8-79b6-468c-982d-b677897a2cb3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:27.510819 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-58c564a8-79b6-468c-982d-b677897a2cb3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:27.511648 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-58c564a8-79b6-468c-982d-b677897a2cb3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:27.516211 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-58c564a8-79b6-468c-982d-b677897a2cb3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:27.523687 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-58c564a8-79b6-468c-982d-b677897a2cb3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:27.567592 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-58c564a8-79b6-468c-982d-b677897a2cb3 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082165 Nov 23 04:17:27.573293 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 274/483] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:27 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:17:27.661017 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a3039d78-cb39-4886-b96a-45c2af868a4d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:27.661631 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a3039d78-cb39-4886-b96a-45c2af868a4d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:27.670158 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a3039d78-cb39-4886-b96a-45c2af868a4d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:27.671411 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a3039d78-cb39-4886-b96a-45c2af868a4d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:27.672383 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-53a19da5-0b86-4f72-957c-be8b2c8ea962 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:27.672817 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a3039d78-cb39-4886-b96a-45c2af868a4d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:27.674713 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a3039d78-cb39-4886-b96a-45c2af868a4d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:27.685755 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-53a19da5-0b86-4f72-957c-be8b2c8ea962 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.299255 Nov 23 04:17:27.688014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 210/484] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:27 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:28.053378 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a3039d78-cb39-4886-b96a-45c2af868a4d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:28.067921 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a3039d78-cb39-4886-b96a-45c2af868a4d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:28.069746 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a3039d78-cb39-4886-b96a-45c2af868a4d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:28.075830 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a3039d78-cb39-4886-b96a-45c2af868a4d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1746 microversion: 2.20 time: 0.420261 Nov 23 04:17:28.087415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 275/485] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:27 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1746 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:28.122589 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2734563e-7290-49c1-aab2-ce70334e9ac1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:28.123867 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2734563e-7290-49c1-aab2-ce70334e9ac1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:28.131381 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2734563e-7290-49c1-aab2-ce70334e9ac1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:28.132104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2734563e-7290-49c1-aab2-ce70334e9ac1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:28.134188 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2734563e-7290-49c1-aab2-ce70334e9ac1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:28.134798 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2734563e-7290-49c1-aab2-ce70334e9ac1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:28.422474 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2734563e-7290-49c1-aab2-ce70334e9ac1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:28.435430 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2734563e-7290-49c1-aab2-ce70334e9ac1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.316347 Nov 23 04:17:28.436297 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 211/486] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:28 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:28.580350 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ad91d618-c08e-4229-b2e7-ac5c42918929 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:28.581896 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ad91d618-c08e-4229-b2e7-ac5c42918929 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:28.603468 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad91d618-c08e-4229-b2e7-ac5c42918929 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:28.603932 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad91d618-c08e-4229-b2e7-ac5c42918929 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:28.604745 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad91d618-c08e-4229-b2e7-ac5c42918929 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:28.605204 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad91d618-c08e-4229-b2e7-ac5c42918929 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:28.647512 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ad91d618-c08e-4229-b2e7-ac5c42918929 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070986 Nov 23 04:17:28.649898 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 276/487] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:28 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:28.704824 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-de48e07a-3e15-4faa-91ef-0bdf1fe21172 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:28.705546 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-de48e07a-3e15-4faa-91ef-0bdf1fe21172 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:28.720700 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-de48e07a-3e15-4faa-91ef-0bdf1fe21172 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:28.721155 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-de48e07a-3e15-4faa-91ef-0bdf1fe21172 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:28.722111 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-de48e07a-3e15-4faa-91ef-0bdf1fe21172 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:28.722383 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-de48e07a-3e15-4faa-91ef-0bdf1fe21172 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:28.967066 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-de48e07a-3e15-4faa-91ef-0bdf1fe21172 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:28.976706 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-de48e07a-3e15-4faa-91ef-0bdf1fe21172 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.275078 Nov 23 04:17:28.984232 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 212/488] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:28 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:29.029791 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-470b2db0-d52b-4021-a892-ac5e4562aa2f req-950d1c02-0d02-45ca-b70c-ca4d17ba31d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f26ee12-392f-434a-855d-c0de8604fecc", "tag": "7939ac63-d4e3-48e0-af74-c5226731ece7"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:29.032306 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:17:29.032306 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:17:29.041384 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-470b2db0-d52b-4021-a892-ac5e4562aa2f req-950d1c02-0d02-45ca-b70c-ca4d17ba31d2 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:29.042096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-470b2db0-d52b-4021-a892-ac5e4562aa2f req-950d1c02-0d02-45ca-b70c-ca4d17ba31d2 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:29.057172 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-470b2db0-d52b-4021-a892-ac5e4562aa2f req-950d1c02-0d02-45ca-b70c-ca4d17ba31d2 service nova] Creating event network-changed:7939ac63-d4e3-48e0-af74-c5226731ece7 for instance 3f26ee12-392f-434a-855d-c0de8604fecc on hv-cinder-76845 Nov 23 04:17:29.062536 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-470b2db0-d52b-4021-a892-ac5e4562aa2f req-950d1c02-0d02-45ca-b70c-ca4d17ba31d2 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039565 Nov 23 04:17:29.063969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 277/489] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:17:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:29.106782 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5bc921ba-0578-4e12-aacc-343ae27e6422 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:29.109305 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5bc921ba-0578-4e12-aacc-343ae27e6422 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:29.118537 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bc921ba-0578-4e12-aacc-343ae27e6422 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:29.118990 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bc921ba-0578-4e12-aacc-343ae27e6422 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:29.119970 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bc921ba-0578-4e12-aacc-343ae27e6422 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:29.126213 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bc921ba-0578-4e12-aacc-343ae27e6422 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:29.443283 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5bc921ba-0578-4e12-aacc-343ae27e6422 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:29.452859 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6429f15c-2f35-4128-bd20-b2176fe62a1b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:29.456782 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6429f15c-2f35-4128-bd20-b2176fe62a1b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:29.458330 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5bc921ba-0578-4e12-aacc-343ae27e6422 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:29.460901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6429f15c-2f35-4128-bd20-b2176fe62a1b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:29.461320 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5bc921ba-0578-4e12-aacc-343ae27e6422 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:29.461453 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6429f15c-2f35-4128-bd20-b2176fe62a1b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:29.462152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6429f15c-2f35-4128-bd20-b2176fe62a1b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:29.462595 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6429f15c-2f35-4128-bd20-b2176fe62a1b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:29.463436 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5bc921ba-0578-4e12-aacc-343ae27e6422 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1748 microversion: 2.20 time: 0.366546 Nov 23 04:17:29.476166 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 213/490] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:29 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1748 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:29.640225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6429f15c-2f35-4128-bd20-b2176fe62a1b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:29.652210 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6429f15c-2f35-4128-bd20-b2176fe62a1b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.203801 Nov 23 04:17:29.653517 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 278/491] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:29 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:29.669491 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1894c0f4-6694-4362-9cc8-d4eb24f3adb1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:29.670813 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1894c0f4-6694-4362-9cc8-d4eb24f3adb1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:29.686445 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1894c0f4-6694-4362-9cc8-d4eb24f3adb1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:29.688188 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1894c0f4-6694-4362-9cc8-d4eb24f3adb1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:29.689569 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1894c0f4-6694-4362-9cc8-d4eb24f3adb1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:29.690238 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1894c0f4-6694-4362-9cc8-d4eb24f3adb1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:29.729140 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1894c0f4-6694-4362-9cc8-d4eb24f3adb1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064321 Nov 23 04:17:29.729927 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 214/492] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:29 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:17:30.001209 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d986b59b-85d8-4335-a801-427a0db0e22d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:30.001936 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d986b59b-85d8-4335-a801-427a0db0e22d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:30.010692 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d986b59b-85d8-4335-a801-427a0db0e22d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:30.015748 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d986b59b-85d8-4335-a801-427a0db0e22d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:30.017277 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d986b59b-85d8-4335-a801-427a0db0e22d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:30.017961 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d986b59b-85d8-4335-a801-427a0db0e22d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:30.246229 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d986b59b-85d8-4335-a801-427a0db0e22d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:30.254330 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d986b59b-85d8-4335-a801-427a0db0e22d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.257270 Nov 23 04:17:30.254880 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 279/493] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:29 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:30.483146 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3845908f-f876-4f59-b47c-b2afdc37e9d2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:30.483807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3845908f-f876-4f59-b47c-b2afdc37e9d2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:30.493600 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3845908f-f876-4f59-b47c-b2afdc37e9d2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:30.494391 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3845908f-f876-4f59-b47c-b2afdc37e9d2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:30.495282 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3845908f-f876-4f59-b47c-b2afdc37e9d2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:30.495722 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3845908f-f876-4f59-b47c-b2afdc37e9d2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:30.662041 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3845908f-f876-4f59-b47c-b2afdc37e9d2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:30.673460 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3845908f-f876-4f59-b47c-b2afdc37e9d2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:30.674388 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5ecbd7ff-94fd-4142-b2ba-32491c2359b6 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:30.675254 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5ecbd7ff-94fd-4142-b2ba-32491c2359b6 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:30.676709 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3845908f-f876-4f59-b47c-b2afdc37e9d2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:30.678743 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3845908f-f876-4f59-b47c-b2afdc37e9d2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1748 microversion: 2.20 time: 0.199574 Nov 23 04:17:30.680682 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 215/494] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:30 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1748 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:30.694367 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5ecbd7ff-94fd-4142-b2ba-32491c2359b6 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:30.695678 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5ecbd7ff-94fd-4142-b2ba-32491c2359b6 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:30.696936 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5ecbd7ff-94fd-4142-b2ba-32491c2359b6 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:30.697473 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5ecbd7ff-94fd-4142-b2ba-32491c2359b6 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:30.846750 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5ecbd7ff-94fd-4142-b2ba-32491c2359b6 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:30.856558 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5ecbd7ff-94fd-4142-b2ba-32491c2359b6 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.189350 Nov 23 04:17:30.857140 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 280/495] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:30 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:31.278547 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d8ad2848-7525-4410-9eff-e4d8ed6b7a09 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:31.279153 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d8ad2848-7525-4410-9eff-e4d8ed6b7a09 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:31.285072 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d8ad2848-7525-4410-9eff-e4d8ed6b7a09 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:31.285514 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d8ad2848-7525-4410-9eff-e4d8ed6b7a09 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:31.286282 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d8ad2848-7525-4410-9eff-e4d8ed6b7a09 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:31.286710 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d8ad2848-7525-4410-9eff-e4d8ed6b7a09 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:31.422214 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d8ad2848-7525-4410-9eff-e4d8ed6b7a09 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:31.430447 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d8ad2848-7525-4410-9eff-e4d8ed6b7a09 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.155524 Nov 23 04:17:31.431595 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 216/496] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:31 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:31.699582 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c633ffb2-c8fb-4d61-b497-0ced27473e3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:31.701210 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c633ffb2-c8fb-4d61-b497-0ced27473e3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:31.708990 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c633ffb2-c8fb-4d61-b497-0ced27473e3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:31.713615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c633ffb2-c8fb-4d61-b497-0ced27473e3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:31.717417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c633ffb2-c8fb-4d61-b497-0ced27473e3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:31.717417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c633ffb2-c8fb-4d61-b497-0ced27473e3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:31.871001 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c633ffb2-c8fb-4d61-b497-0ced27473e3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:31.873916 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fa37a9af-ff47-4845-879e-6a743ffa6eba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:31.874534 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fa37a9af-ff47-4845-879e-6a743ffa6eba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:31.881238 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c633ffb2-c8fb-4d61-b497-0ced27473e3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:31.881507 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fa37a9af-ff47-4845-879e-6a743ffa6eba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:31.882219 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fa37a9af-ff47-4845-879e-6a743ffa6eba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:31.883920 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fa37a9af-ff47-4845-879e-6a743ffa6eba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:31.884568 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c633ffb2-c8fb-4d61-b497-0ced27473e3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:31.884775 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fa37a9af-ff47-4845-879e-6a743ffa6eba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:31.886604 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c633ffb2-c8fb-4d61-b497-0ced27473e3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1748 microversion: 2.20 time: 0.192439 Nov 23 04:17:31.899034 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 281/497] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:31 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1748 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:32.041840 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fa37a9af-ff47-4845-879e-6a743ffa6eba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:32.050430 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fa37a9af-ff47-4845-879e-6a743ffa6eba tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1566 microversion: 2.1 time: 0.180315 Nov 23 04:17:32.051000 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 217/498] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:31 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:32.448794 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f644b529-9145-4218-a1e0-53e159a0f659 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:32.449484 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f644b529-9145-4218-a1e0-53e159a0f659 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:32.455966 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f644b529-9145-4218-a1e0-53e159a0f659 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:32.457244 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f644b529-9145-4218-a1e0-53e159a0f659 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:32.458399 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f644b529-9145-4218-a1e0-53e159a0f659 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:32.458842 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f644b529-9145-4218-a1e0-53e159a0f659 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:32.508849 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1c980916-a1d2-42c8-b866-564f44dd8f74 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:32.509375 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1c980916-a1d2-42c8-b866-564f44dd8f74 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:32.515314 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1c980916-a1d2-42c8-b866-564f44dd8f74 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:32.515766 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1c980916-a1d2-42c8-b866-564f44dd8f74 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:32.516552 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1c980916-a1d2-42c8-b866-564f44dd8f74 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:32.517044 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1c980916-a1d2-42c8-b866-564f44dd8f74 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:32.541606 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1c980916-a1d2-42c8-b866-564f44dd8f74 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Going to try to terminate instance {{(pid=116837) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:17:32.593463 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f644b529-9145-4218-a1e0-53e159a0f659 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:32.611015 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f644b529-9145-4218-a1e0-53e159a0f659 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.158869 Nov 23 04:17:32.611015 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 282/499] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:32 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:32.617698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3c949aac-0d91-4ae1-b091-7a3128dce428 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Action: 'create', calling method: .version_select at 0x7fa7dd8145e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-979248207"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:32.634548 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-3c949aac-0d91-4ae1-b091-7a3128dce428 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Getting quotas for project 0dcc5d168617498bbafe5038567ca011. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:17:32.636210 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-3c949aac-0d91-4ae1-b091-7a3128dce428 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Getting quotas for user 21a1d655b7be402c9339cfd5d09215f5 and project 0dcc5d168617498bbafe5038567ca011. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:17:32.647955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c949aac-0d91-4ae1-b091-7a3128dce428 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [b4b58198-de70-4f1c-b2f7-5717d0a83678] AMQP server on 10.222.0.54:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 04:17:32.862685 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1c980916-a1d2-42c8-b866-564f44dd8f74 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "DELETE /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 204 len: 0 microversion: 2.1 time: 0.358094 Nov 23 04:17:32.863494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 218/500] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:17:32 2021] DELETE /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 04:17:32.874947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1cb17b0b-0c2b-46fd-976a-27cd670de78e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:32.875781 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1cb17b0b-0c2b-46fd-976a-27cd670de78e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:32.883923 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1cb17b0b-0c2b-46fd-976a-27cd670de78e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:32.884389 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1cb17b0b-0c2b-46fd-976a-27cd670de78e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:32.885204 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1cb17b0b-0c2b-46fd-976a-27cd670de78e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:32.885632 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1cb17b0b-0c2b-46fd-976a-27cd670de78e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:33.065928 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1cb17b0b-0c2b-46fd-976a-27cd670de78e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:33.073584 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1cb17b0b-0c2b-46fd-976a-27cd670de78e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1514 microversion: 2.1 time: 0.204599 Nov 23 04:17:33.074325 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 219/501] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:32 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:33.082485 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-534b0e4b-f14d-40ba-9246-0a98e0738e2b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:33.083299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-534b0e4b-f14d-40ba-9246-0a98e0738e2b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:33.092131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-534b0e4b-f14d-40ba-9246-0a98e0738e2b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:33.092698 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-534b0e4b-f14d-40ba-9246-0a98e0738e2b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:33.093577 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-534b0e4b-f14d-40ba-9246-0a98e0738e2b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:33.094182 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-534b0e4b-f14d-40ba-9246-0a98e0738e2b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:33.524949 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-534b0e4b-f14d-40ba-9246-0a98e0738e2b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:33.533293 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-534b0e4b-f14d-40ba-9246-0a98e0738e2b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:33.534985 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-534b0e4b-f14d-40ba-9246-0a98e0738e2b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:33.536160 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-534b0e4b-f14d-40ba-9246-0a98e0738e2b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.460925 Nov 23 04:17:33.536729 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 220/502] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:33 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:33.541438 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8513c403-5fca-4ac7-911c-9e4cfae0d82f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:33.543367 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8513c403-5fca-4ac7-911c-9e4cfae0d82f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:33.547850 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8513c403-5fca-4ac7-911c-9e4cfae0d82f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:33.548345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8513c403-5fca-4ac7-911c-9e4cfae0d82f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:33.549121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8513c403-5fca-4ac7-911c-9e4cfae0d82f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:33.549552 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8513c403-5fca-4ac7-911c-9e4cfae0d82f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:33.667373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c949aac-0d91-4ae1-b091-7a3128dce428 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [b4b58198-de70-4f1c-b2f7-5717d0a83678] Reconnected to AMQP server on 10.222.0.54:5672 via [amqp] client with port 48172. Nov 23 04:17:33.759362 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8513c403-5fca-4ac7-911c-9e4cfae0d82f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:33.767881 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8513c403-5fca-4ac7-911c-9e4cfae0d82f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1546 microversion: 2.1 time: 0.230210 Nov 23 04:17:33.768695 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 221/503] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:33 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1546 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:33.781882 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b97b171c-aec7-48bb-9517-1fea784d7dbf tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:33.782520 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b97b171c-aec7-48bb-9517-1fea784d7dbf tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:33.788447 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b97b171c-aec7-48bb-9517-1fea784d7dbf tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:33.789202 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b97b171c-aec7-48bb-9517-1fea784d7dbf tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:33.789948 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b97b171c-aec7-48bb-9517-1fea784d7dbf tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:33.790386 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b97b171c-aec7-48bb-9517-1fea784d7dbf tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:33.973411 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-b97b171c-aec7-48bb-9517-1fea784d7dbf tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:33.981693 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-3c949aac-0d91-4ae1-b091-7a3128dce428 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Getting quotas for project 0dcc5d168617498bbafe5038567ca011. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:17:33.981911 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b97b171c-aec7-48bb-9517-1fea784d7dbf tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.205039 Nov 23 04:17:33.982778 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 222/504] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:33 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:33.985798 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-3c949aac-0d91-4ae1-b091-7a3128dce428 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Getting quotas for user 21a1d655b7be402c9339cfd5d09215f5 and project 0dcc5d168617498bbafe5038567ca011. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:17:33.987304 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a032dfda-47b6-456e-ada3-dcc6fc86140f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:33.988015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a032dfda-47b6-456e-ada3-dcc6fc86140f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:33.994476 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a032dfda-47b6-456e-ada3-dcc6fc86140f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:33.997460 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a032dfda-47b6-456e-ada3-dcc6fc86140f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:33.997460 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a032dfda-47b6-456e-ada3-dcc6fc86140f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:33.997460 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a032dfda-47b6-456e-ada3-dcc6fc86140f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.001645 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3c949aac-0d91-4ae1-b091-7a3128dce428 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 1.387702 Nov 23 04:17:34.002596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 283/505] 10.222.0.54 () {60 vars in 1157 bytes} [Tue Nov 23 04:17:32 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:34.053496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-31933235", "imageRef": "c0b6f42a-7ff4-4561-bd41-390410af82dd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-979248207", "networks": [{"uuid": "637e7c09-45c2-45a1-ba70-21290f7e9dbe"}]}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:34.083500 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-a032dfda-47b6-456e-ada3-dcc6fc86140f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] HTTP exception thrown: Cannot 'detach_volume' instance 696e3da2-6fdb-4741-8f4f-fffccaf8d403 while it is in vm_state rescued Nov 23 04:17:34.084103 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a032dfda-47b6-456e-ada3-dcc6fc86140f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Returning 409 to user: Cannot 'detach_volume' instance 696e3da2-6fdb-4741-8f4f-fffccaf8d403 while it is in vm_state rescued {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:17:34.084942 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a032dfda-47b6-456e-ada3-dcc6fc86140f tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "DELETE /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments/b90a1ac4-8fa1-4bc4-a1bd-cc5efd87b7f3" status: 409 len: 152 microversion: 2.1 time: 0.101234 Nov 23 04:17:34.086435 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 223/506] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:17:33 2021] DELETE /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments/b90a1ac4-8fa1-4bc4-a1bd-cc5efd87b7f3 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 23 04:17:34.090823 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b700f173-36fa-4bda-ae4e-ecb3ca448c76 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:34.096434 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b700f173-36fa-4bda-ae4e-ecb3ca448c76 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:34.097223 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b700f173-36fa-4bda-ae4e-ecb3ca448c76 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:34.097674 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b700f173-36fa-4bda-ae4e-ecb3ca448c76 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.098826 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b700f173-36fa-4bda-ae4e-ecb3ca448c76 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:34.099307 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b700f173-36fa-4bda-ae4e-ecb3ca448c76 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.120656 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] validate_networks() for [('637e7c09-45c2-45a1-ba70-21290f7e9dbe', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:17:34.340807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-b700f173-36fa-4bda-ae4e-ecb3ca448c76 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:34.352538 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b700f173-36fa-4bda-ae4e-ecb3ca448c76 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1514 microversion: 2.1 time: 0.265073 Nov 23 04:17:34.353649 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 224/507] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:34 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:34.359726 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-118016a7-7725-404a-bd6a-24f9eb4cd251 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:34.360482 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-118016a7-7725-404a-bd6a-24f9eb4cd251 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:34.368343 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-118016a7-7725-404a-bd6a-24f9eb4cd251 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:34.369147 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-118016a7-7725-404a-bd6a-24f9eb4cd251 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.370350 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-118016a7-7725-404a-bd6a-24f9eb4cd251 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:34.371119 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-118016a7-7725-404a-bd6a-24f9eb4cd251 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.572371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-118016a7-7725-404a-bd6a-24f9eb4cd251 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/action" status: 202 len: 0 microversion: 2.1 time: 0.217143 Nov 23 04:17:34.575056 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 225/508] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:17:34 2021] POST /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:17:34.579726 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9f360830-a352-41a5-a412-18d719732202 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:34.580615 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9f360830-a352-41a5-a412-18d719732202 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:34.588649 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f360830-a352-41a5-a412-18d719732202 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:34.589102 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f360830-a352-41a5-a412-18d719732202 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.589889 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f360830-a352-41a5-a412-18d719732202 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:34.590310 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9f360830-a352-41a5-a412-18d719732202 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.638517 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:17:34.638943 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:17:34.639452 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:17:34.639873 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:17:34.640279 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:17:34.649600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:34.650133 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.651052 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:34.651581 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.674873 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Getting quotas for project 0dcc5d168617498bbafe5038567ca011. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:17:34.680430 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Getting quotas for user 21a1d655b7be402c9339cfd5d09215f5 and project 0dcc5d168617498bbafe5038567ca011. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:17:34.692418 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:17:34.695380 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0b6f42a-7ff4-4561-bd41-390410af82dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:17:34.740481 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9f360830-a352-41a5-a412-18d719732202 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:34.757202 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9f360830-a352-41a5-a412-18d719732202 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:34.758718 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9f360830-a352-41a5-a412-18d719732202 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:34.760443 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9f360830-a352-41a5-a412-18d719732202 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.185807 Nov 23 04:17:34.761297 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 226/509] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:34 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:34.775805 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f63d1801-0736-44d4-9db6-bf6e637a3776 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:34.776550 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f63d1801-0736-44d4-9db6-bf6e637a3776 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:34.783380 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f63d1801-0736-44d4-9db6-bf6e637a3776 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:34.783830 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f63d1801-0736-44d4-9db6-bf6e637a3776 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.786802 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f63d1801-0736-44d4-9db6-bf6e637a3776 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:34.787494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f63d1801-0736-44d4-9db6-bf6e637a3776 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:34.901596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-67687357-b9bb-417c-aab2-01b1375e972d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852175 Nov 23 04:17:34.904592 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 284/510] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:17:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:17:34.912828 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-cbdf0d10-5d98-4c2c-93e2-22f721cc3d3e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:34.922224 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-cbdf0d10-5d98-4c2c-93e2-22f721cc3d3e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:35.036762 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-cbdf0d10-5d98-4c2c-93e2-22f721cc3d3e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:35.060430 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-cbdf0d10-5d98-4c2c-93e2-22f721cc3d3e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1256 microversion: 2.1 time: 0.147718 Nov 23 04:17:35.070860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 285/511] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:34 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1256 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:35.070860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a49ff1cc-a27b-4ff0-a8ae-7fbf7f538239 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:35.073190 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a49ff1cc-a27b-4ff0-a8ae-7fbf7f538239 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:35.088097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a49ff1cc-a27b-4ff0-a8ae-7fbf7f538239 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:35.089419 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a49ff1cc-a27b-4ff0-a8ae-7fbf7f538239 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:35.090220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a49ff1cc-a27b-4ff0-a8ae-7fbf7f538239 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:35.090661 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a49ff1cc-a27b-4ff0-a8ae-7fbf7f538239 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:35.240028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f63d1801-0736-44d4-9db6-bf6e637a3776 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:35.249612 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f63d1801-0736-44d4-9db6-bf6e637a3776 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.487018 Nov 23 04:17:35.250824 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 227/512] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:34 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:35.371733 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f0e647ef-d3eb-465b-a18c-85f206873fcf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:35.373085 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f0e647ef-d3eb-465b-a18c-85f206873fcf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:35.387178 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f0e647ef-d3eb-465b-a18c-85f206873fcf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:35.401059 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f0e647ef-d3eb-465b-a18c-85f206873fcf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:35.407269 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f0e647ef-d3eb-465b-a18c-85f206873fcf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:35.408319 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f0e647ef-d3eb-465b-a18c-85f206873fcf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:35.463290 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a49ff1cc-a27b-4ff0-a8ae-7fbf7f538239 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:35.475848 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a49ff1cc-a27b-4ff0-a8ae-7fbf7f538239 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.413013 Nov 23 04:17:35.476592 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 286/513] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:35 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:35.498766 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-41f87558-7760-4df3-a774-8a21bdd7bdb0 req-dca91512-0f48-418f-af62-3b40a862fa33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f26ee12-392f-434a-855d-c0de8604fecc", "name": "network-vif-plugged", "status": "completed", "tag": "7939ac63-d4e3-48e0-af74-c5226731ece7"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:35.504993 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:17:35.504993 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:17:35.524666 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-41f87558-7760-4df3-a774-8a21bdd7bdb0 req-dca91512-0f48-418f-af62-3b40a862fa33 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:35.525469 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-41f87558-7760-4df3-a774-8a21bdd7bdb0 req-dca91512-0f48-418f-af62-3b40a862fa33 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:35.539937 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-41f87558-7760-4df3-a774-8a21bdd7bdb0 req-dca91512-0f48-418f-af62-3b40a862fa33 service nova] Creating event network-vif-plugged:7939ac63-d4e3-48e0-af74-c5226731ece7 for instance 3f26ee12-392f-434a-855d-c0de8604fecc on hv-cinder-76845 Nov 23 04:17:35.546441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-41f87558-7760-4df3-a774-8a21bdd7bdb0 req-dca91512-0f48-418f-af62-3b40a862fa33 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065336 Nov 23 04:17:35.547560 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 287/514] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:17:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:35.778869 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-be37c8ba-9d82-4430-8b5a-0f4c2ee1ce9b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:35.783556 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-be37c8ba-9d82-4430-8b5a-0f4c2ee1ce9b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:35.798234 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be37c8ba-9d82-4430-8b5a-0f4c2ee1ce9b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:35.798694 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be37c8ba-9d82-4430-8b5a-0f4c2ee1ce9b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:35.799600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be37c8ba-9d82-4430-8b5a-0f4c2ee1ce9b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:35.800232 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-be37c8ba-9d82-4430-8b5a-0f4c2ee1ce9b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:35.940477 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f0e647ef-d3eb-465b-a18c-85f206873fcf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:35.954107 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f0e647ef-d3eb-465b-a18c-85f206873fcf tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1514 microversion: 2.1 time: 0.587712 Nov 23 04:17:35.955155 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 228/515] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:35 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1514 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:36.079139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ceb99cbe-81c7-4adb-a79a-454d4e909dbf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:36.080637 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ceb99cbe-81c7-4adb-a79a-454d4e909dbf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:36.133307 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-be37c8ba-9d82-4430-8b5a-0f4c2ee1ce9b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:36.145262 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-be37c8ba-9d82-4430-8b5a-0f4c2ee1ce9b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:36.147007 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-be37c8ba-9d82-4430-8b5a-0f4c2ee1ce9b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:36.160772 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-be37c8ba-9d82-4430-8b5a-0f4c2ee1ce9b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.386025 Nov 23 04:17:36.161353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 288/516] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:35 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:36.184945 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ceb99cbe-81c7-4adb-a79a-454d4e909dbf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:36.191570 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ceb99cbe-81c7-4adb-a79a-454d4e909dbf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1256 microversion: 2.1 time: 0.117080 Nov 23 04:17:36.192327 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 229/517] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:36 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1256 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:36.269772 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5d37dd79-85f3-4558-80c7-8cfaaff6b3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:36.270543 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5d37dd79-85f3-4558-80c7-8cfaaff6b3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:36.277764 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5d37dd79-85f3-4558-80c7-8cfaaff6b3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:36.278289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5d37dd79-85f3-4558-80c7-8cfaaff6b3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:36.279183 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5d37dd79-85f3-4558-80c7-8cfaaff6b3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:36.279560 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5d37dd79-85f3-4558-80c7-8cfaaff6b3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:36.495983 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b8471917-1b96-4ded-9905-d22ca903b89f tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:36.496785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b8471917-1b96-4ded-9905-d22ca903b89f tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:36.506917 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b8471917-1b96-4ded-9905-d22ca903b89f tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:36.509160 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b8471917-1b96-4ded-9905-d22ca903b89f tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:36.510413 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b8471917-1b96-4ded-9905-d22ca903b89f tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:36.511927 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b8471917-1b96-4ded-9905-d22ca903b89f tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:36.532030 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5d37dd79-85f3-4558-80c7-8cfaaff6b3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:36.540130 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5d37dd79-85f3-4558-80c7-8cfaaff6b3c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.274424 Nov 23 04:17:36.542144 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 289/518] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:36 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:36.546768 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-49441c7d-dc54-42b7-bf27-74937ecd6e81 req-1fbf1314-4bed-4fad-b6d1-5173a5aa2e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5694f710-d745-44e4-9b59-55d54a09515d", "name": "network-vif-deleted", "tag": "17ac3a98-501a-42f8-b6c9-52d0039362e2"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:36.549031 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:17:36.549031 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:17:36.557326 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-49441c7d-dc54-42b7-bf27-74937ecd6e81 req-1fbf1314-4bed-4fad-b6d1-5173a5aa2e42 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:36.557876 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-49441c7d-dc54-42b7-bf27-74937ecd6e81 req-1fbf1314-4bed-4fad-b6d1-5173a5aa2e42 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:36.570714 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-49441c7d-dc54-42b7-bf27-74937ecd6e81 req-1fbf1314-4bed-4fad-b6d1-5173a5aa2e42 service nova] Creating event network-vif-deleted:17ac3a98-501a-42f8-b6c9-52d0039362e2 for instance 5694f710-d745-44e4-9b59-55d54a09515d on hv-cinder-76845 Nov 23 04:17:36.580282 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-49441c7d-dc54-42b7-bf27-74937ecd6e81 req-1fbf1314-4bed-4fad-b6d1-5173a5aa2e42 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037008 Nov 23 04:17:36.582098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 290/519] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:17:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:36.706032 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-b8471917-1b96-4ded-9905-d22ca903b89f tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:36.718857 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b8471917-1b96-4ded-9905-d22ca903b89f tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.228611 Nov 23 04:17:36.720418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 230/520] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:36 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:36.971654 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-42de67eb-696e-4841-970d-92e66f80ddd8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:36.972267 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-42de67eb-696e-4841-970d-92e66f80ddd8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:36.978850 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42de67eb-696e-4841-970d-92e66f80ddd8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:36.979321 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42de67eb-696e-4841-970d-92e66f80ddd8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:36.980097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42de67eb-696e-4841-970d-92e66f80ddd8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:36.980528 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42de67eb-696e-4841-970d-92e66f80ddd8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:37.043836 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-42de67eb-696e-4841-970d-92e66f80ddd8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:37.053141 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-42de67eb-696e-4841-970d-92e66f80ddd8 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1472 microversion: 2.1 time: 0.085405 Nov 23 04:17:37.055232 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 291/521] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:36 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1472 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:37.180197 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9481fc65-f121-456b-be5d-7081b4aa4265 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:37.181284 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9481fc65-f121-456b-be5d-7081b4aa4265 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:37.188351 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9481fc65-f121-456b-be5d-7081b4aa4265 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:37.189210 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9481fc65-f121-456b-be5d-7081b4aa4265 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:37.190173 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9481fc65-f121-456b-be5d-7081b4aa4265 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:37.190661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9481fc65-f121-456b-be5d-7081b4aa4265 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:37.209017 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9a6561f6-26d9-4199-8c8e-7bfc58d041f6 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:37.209664 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9a6561f6-26d9-4199-8c8e-7bfc58d041f6 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:37.216117 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9a6561f6-26d9-4199-8c8e-7bfc58d041f6 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:37.216572 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9a6561f6-26d9-4199-8c8e-7bfc58d041f6 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:37.217362 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9a6561f6-26d9-4199-8c8e-7bfc58d041f6 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:37.217803 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9a6561f6-26d9-4199-8c8e-7bfc58d041f6 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:37.282559 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9a6561f6-26d9-4199-8c8e-7bfc58d041f6 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:37.289822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9a6561f6-26d9-4199-8c8e-7bfc58d041f6 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1260 microversion: 2.1 time: 0.084323 Nov 23 04:17:37.290762 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 292/522] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:37 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1260 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:37.353578 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9481fc65-f121-456b-be5d-7081b4aa4265 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:37.362106 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9481fc65-f121-456b-be5d-7081b4aa4265 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:37.363638 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9481fc65-f121-456b-be5d-7081b4aa4265 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:37.364843 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9481fc65-f121-456b-be5d-7081b4aa4265 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.188859 Nov 23 04:17:37.365408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 231/523] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:37 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:37.558337 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3dc66f08-c560-44e6-ae50-bc31f5c6f253 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:37.558855 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3dc66f08-c560-44e6-ae50-bc31f5c6f253 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:37.564699 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3dc66f08-c560-44e6-ae50-bc31f5c6f253 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:37.565144 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3dc66f08-c560-44e6-ae50-bc31f5c6f253 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:37.565916 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3dc66f08-c560-44e6-ae50-bc31f5c6f253 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:37.566348 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3dc66f08-c560-44e6-ae50-bc31f5c6f253 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:37.718486 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3dc66f08-c560-44e6-ae50-bc31f5c6f253 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:37.725743 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3dc66f08-c560-44e6-ae50-bc31f5c6f253 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.171817 Nov 23 04:17:37.727289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 293/524] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:37 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:37.736194 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-21755f80-6b5f-4e2a-922c-9efea69e6736 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:37.737384 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-21755f80-6b5f-4e2a-922c-9efea69e6736 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:37.743843 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21755f80-6b5f-4e2a-922c-9efea69e6736 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:37.744304 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21755f80-6b5f-4e2a-922c-9efea69e6736 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:37.745202 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21755f80-6b5f-4e2a-922c-9efea69e6736 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:37.745647 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21755f80-6b5f-4e2a-922c-9efea69e6736 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:37.892319 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-21755f80-6b5f-4e2a-922c-9efea69e6736 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:37.901288 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-21755f80-6b5f-4e2a-922c-9efea69e6736 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.168875 Nov 23 04:17:37.901866 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 232/525] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:37 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:38.078579 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d69e99a4-ea0c-4e92-9d2e-8e5381bf8505 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:38.079240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d69e99a4-ea0c-4e92-9d2e-8e5381bf8505 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:38.086890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d69e99a4-ea0c-4e92-9d2e-8e5381bf8505 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:38.087388 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d69e99a4-ea0c-4e92-9d2e-8e5381bf8505 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:38.088369 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d69e99a4-ea0c-4e92-9d2e-8e5381bf8505 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:38.088885 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d69e99a4-ea0c-4e92-9d2e-8e5381bf8505 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:38.181056 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d69e99a4-ea0c-4e92-9d2e-8e5381bf8505 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:38.188484 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d69e99a4-ea0c-4e92-9d2e-8e5381bf8505 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1472 microversion: 2.1 time: 0.116297 Nov 23 04:17:38.189055 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 294/526] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:38 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1472 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:38.307788 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-178ba301-751c-4011-a8f1-0c6e72577498 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:38.308492 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-178ba301-751c-4011-a8f1-0c6e72577498 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:38.315401 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-178ba301-751c-4011-a8f1-0c6e72577498 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:38.316169 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-178ba301-751c-4011-a8f1-0c6e72577498 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:38.317056 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-178ba301-751c-4011-a8f1-0c6e72577498 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:38.317708 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-178ba301-751c-4011-a8f1-0c6e72577498 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:38.384028 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4f31bd21-a6b9-45a8-9851-7f429e81f1d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:38.384957 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4f31bd21-a6b9-45a8-9851-7f429e81f1d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:38.391340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f31bd21-a6b9-45a8-9851-7f429e81f1d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:38.391956 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f31bd21-a6b9-45a8-9851-7f429e81f1d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:38.393083 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f31bd21-a6b9-45a8-9851-7f429e81f1d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:38.393622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4f31bd21-a6b9-45a8-9851-7f429e81f1d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:38.396330 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-178ba301-751c-4011-a8f1-0c6e72577498 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:38.404771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-178ba301-751c-4011-a8f1-0c6e72577498 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1260 microversion: 2.1 time: 0.101403 Nov 23 04:17:38.405697 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 233/527] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:38 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1260 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:38.548586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4f31bd21-a6b9-45a8-9851-7f429e81f1d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:38.557714 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4f31bd21-a6b9-45a8-9851-7f429e81f1d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:38.559389 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4f31bd21-a6b9-45a8-9851-7f429e81f1d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:38.560672 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4f31bd21-a6b9-45a8-9851-7f429e81f1d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.180723 Nov 23 04:17:38.568975 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 295/528] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:38 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:38.743930 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3c6defef-c2f6-4d49-9bf4-784ab1bbe0ee tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:38.744865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3c6defef-c2f6-4d49-9bf4-784ab1bbe0ee tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:38.750862 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3c6defef-c2f6-4d49-9bf4-784ab1bbe0ee tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:38.751369 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3c6defef-c2f6-4d49-9bf4-784ab1bbe0ee tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:38.752277 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3c6defef-c2f6-4d49-9bf4-784ab1bbe0ee tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:38.752781 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3c6defef-c2f6-4d49-9bf4-784ab1bbe0ee tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:38.892841 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3c6defef-c2f6-4d49-9bf4-784ab1bbe0ee tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:38.903005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3c6defef-c2f6-4d49-9bf4-784ab1bbe0ee tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.162568 Nov 23 04:17:38.906683 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 234/529] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:38 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:38.919254 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f8029299-6e31-4632-bff4-aec2fea42f07 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:38.919897 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f8029299-6e31-4632-bff4-aec2fea42f07 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:38.925864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8029299-6e31-4632-bff4-aec2fea42f07 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:38.926312 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8029299-6e31-4632-bff4-aec2fea42f07 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:38.927083 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8029299-6e31-4632-bff4-aec2fea42f07 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:38.927542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8029299-6e31-4632-bff4-aec2fea42f07 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:39.070008 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f8029299-6e31-4632-bff4-aec2fea42f07 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:39.078761 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f8029299-6e31-4632-bff4-aec2fea42f07 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.163224 Nov 23 04:17:39.079412 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 296/530] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:38 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:39.204645 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-297434c0-3d5f-4c8c-b9fc-afa74f049b12 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:39.205507 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-297434c0-3d5f-4c8c-b9fc-afa74f049b12 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:39.212191 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-297434c0-3d5f-4c8c-b9fc-afa74f049b12 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:39.212769 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-297434c0-3d5f-4c8c-b9fc-afa74f049b12 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:39.213743 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-297434c0-3d5f-4c8c-b9fc-afa74f049b12 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:39.214619 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-297434c0-3d5f-4c8c-b9fc-afa74f049b12 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:39.276302 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-297434c0-3d5f-4c8c-b9fc-afa74f049b12 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:39.283592 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-297434c0-3d5f-4c8c-b9fc-afa74f049b12 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1472 microversion: 2.1 time: 0.082483 Nov 23 04:17:39.284157 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 235/531] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:39 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1472 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:39.424266 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b42976cb-b2ab-43d7-a7f7-ec51504d3113 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:39.425200 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b42976cb-b2ab-43d7-a7f7-ec51504d3113 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:39.433077 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b42976cb-b2ab-43d7-a7f7-ec51504d3113 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:39.433666 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b42976cb-b2ab-43d7-a7f7-ec51504d3113 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:39.434956 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b42976cb-b2ab-43d7-a7f7-ec51504d3113 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:39.435601 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b42976cb-b2ab-43d7-a7f7-ec51504d3113 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:39.496841 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b42976cb-b2ab-43d7-a7f7-ec51504d3113 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:39.504081 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b42976cb-b2ab-43d7-a7f7-ec51504d3113 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1260 microversion: 2.1 time: 0.083525 Nov 23 04:17:39.504640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 297/532] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:39 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1260 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:39.579754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9e505a30-9236-4cd9-b393-bb42f08f5aad tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:39.580284 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9e505a30-9236-4cd9-b393-bb42f08f5aad tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:39.586359 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9e505a30-9236-4cd9-b393-bb42f08f5aad tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:39.586792 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9e505a30-9236-4cd9-b393-bb42f08f5aad tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:39.587597 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9e505a30-9236-4cd9-b393-bb42f08f5aad tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:39.588028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9e505a30-9236-4cd9-b393-bb42f08f5aad tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:39.732092 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9e505a30-9236-4cd9-b393-bb42f08f5aad tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:39.742343 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9e505a30-9236-4cd9-b393-bb42f08f5aad tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:39.744227 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9e505a30-9236-4cd9-b393-bb42f08f5aad tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:39.745475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9e505a30-9236-4cd9-b393-bb42f08f5aad tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.169552 Nov 23 04:17:39.746226 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 236/533] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:39 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:39.920420 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-40285333-d8e5-494a-a893-bcf28a3546b8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:39.920941 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-40285333-d8e5-494a-a893-bcf28a3546b8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:39.926900 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40285333-d8e5-494a-a893-bcf28a3546b8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:39.927376 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40285333-d8e5-494a-a893-bcf28a3546b8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:39.928168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40285333-d8e5-494a-a893-bcf28a3546b8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:39.928598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40285333-d8e5-494a-a893-bcf28a3546b8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:40.083023 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-40285333-d8e5-494a-a893-bcf28a3546b8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:40.092166 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-40285333-d8e5-494a-a893-bcf28a3546b8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.175348 Nov 23 04:17:40.097253 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e27b4f8f-ad76-481c-a08c-93a92d89572c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:40.097966 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e27b4f8f-ad76-481c-a08c-93a92d89572c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:40.102770 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 298/534] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:39 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:40.105028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e27b4f8f-ad76-481c-a08c-93a92d89572c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:40.105475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e27b4f8f-ad76-481c-a08c-93a92d89572c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:40.106264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e27b4f8f-ad76-481c-a08c-93a92d89572c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:40.106695 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e27b4f8f-ad76-481c-a08c-93a92d89572c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:40.248666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e27b4f8f-ad76-481c-a08c-93a92d89572c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:40.255934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e27b4f8f-ad76-481c-a08c-93a92d89572c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.162392 Nov 23 04:17:40.256498 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 237/535] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:40 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:40.301202 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0678d778-a50b-420c-890d-ea3222e91036 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:40.301775 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0678d778-a50b-420c-890d-ea3222e91036 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:40.308966 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0678d778-a50b-420c-890d-ea3222e91036 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:40.309407 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0678d778-a50b-420c-890d-ea3222e91036 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:40.310219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0678d778-a50b-420c-890d-ea3222e91036 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:40.310622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0678d778-a50b-420c-890d-ea3222e91036 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:40.371283 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0678d778-a50b-420c-890d-ea3222e91036 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:40.379767 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0678d778-a50b-420c-890d-ea3222e91036 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1472 microversion: 2.1 time: 0.081837 Nov 23 04:17:40.387678 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 299/536] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:40 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1472 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:40.520494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-92152f15-b5f8-4358-84c3-64d3ed810b60 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:40.521104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-92152f15-b5f8-4358-84c3-64d3ed810b60 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:40.527428 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-92152f15-b5f8-4358-84c3-64d3ed810b60 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:40.527908 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-92152f15-b5f8-4358-84c3-64d3ed810b60 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:40.528689 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-92152f15-b5f8-4358-84c3-64d3ed810b60 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:40.529124 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-92152f15-b5f8-4358-84c3-64d3ed810b60 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:40.590884 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-92152f15-b5f8-4358-84c3-64d3ed810b60 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:40.599021 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-92152f15-b5f8-4358-84c3-64d3ed810b60 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1260 microversion: 2.1 time: 0.082150 Nov 23 04:17:40.600114 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 238/537] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:40 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1260 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:40.763479 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f8973dda-9e2f-40e8-8f7d-c5667c9ca3c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:40.764202 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f8973dda-9e2f-40e8-8f7d-c5667c9ca3c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:40.770195 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8973dda-9e2f-40e8-8f7d-c5667c9ca3c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:40.848819 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8973dda-9e2f-40e8-8f7d-c5667c9ca3c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:40.848819 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8973dda-9e2f-40e8-8f7d-c5667c9ca3c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:40.848819 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8973dda-9e2f-40e8-8f7d-c5667c9ca3c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:40.907802 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f8973dda-9e2f-40e8-8f7d-c5667c9ca3c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:40.917451 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f8973dda-9e2f-40e8-8f7d-c5667c9ca3c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:40.918922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f8973dda-9e2f-40e8-8f7d-c5667c9ca3c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:40.920168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f8973dda-9e2f-40e8-8f7d-c5667c9ca3c0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.160447 Nov 23 04:17:40.920739 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 300/538] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:40 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:41.109641 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fa3c17e4-02a5-4a2e-90f3-370f35bfb6d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:41.110189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fa3c17e4-02a5-4a2e-90f3-370f35bfb6d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:41.116808 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fa3c17e4-02a5-4a2e-90f3-370f35bfb6d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:41.117266 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fa3c17e4-02a5-4a2e-90f3-370f35bfb6d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:41.118058 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fa3c17e4-02a5-4a2e-90f3-370f35bfb6d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:41.118516 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fa3c17e4-02a5-4a2e-90f3-370f35bfb6d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:41.256770 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fa3c17e4-02a5-4a2e-90f3-370f35bfb6d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:41.266266 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fa3c17e4-02a5-4a2e-90f3-370f35bfb6d9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.160423 Nov 23 04:17:41.267264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 239/539] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:41 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:41.274114 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1352b67b-d7f1-4c4f-9498-b5a0f4c2d505 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:41.274764 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1352b67b-d7f1-4c4f-9498-b5a0f4c2d505 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:41.282928 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1352b67b-d7f1-4c4f-9498-b5a0f4c2d505 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:41.283470 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1352b67b-d7f1-4c4f-9498-b5a0f4c2d505 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:41.284355 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1352b67b-d7f1-4c4f-9498-b5a0f4c2d505 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:41.284910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1352b67b-d7f1-4c4f-9498-b5a0f4c2d505 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:41.397064 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f20955c7-a754-4c46-b29a-a425ee80e3c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:41.398271 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f20955c7-a754-4c46-b29a-a425ee80e3c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:41.406121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f20955c7-a754-4c46-b29a-a425ee80e3c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:41.406892 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f20955c7-a754-4c46-b29a-a425ee80e3c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:41.407937 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f20955c7-a754-4c46-b29a-a425ee80e3c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:41.408381 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f20955c7-a754-4c46-b29a-a425ee80e3c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:41.439861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1352b67b-d7f1-4c4f-9498-b5a0f4c2d505 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:41.447987 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1352b67b-d7f1-4c4f-9498-b5a0f4c2d505 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.178959 Nov 23 04:17:41.448551 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 301/540] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:41 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:41.479015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f20955c7-a754-4c46-b29a-a425ee80e3c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:41.487095 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f20955c7-a754-4c46-b29a-a425ee80e3c1 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1472 microversion: 2.1 time: 0.094234 Nov 23 04:17:41.493577 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 240/541] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:41 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1472 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:41.618378 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1ad7edd9-fef5-46c3-81d4-1836976d2170 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:41.619203 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1ad7edd9-fef5-46c3-81d4-1836976d2170 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:41.625912 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1ad7edd9-fef5-46c3-81d4-1836976d2170 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:41.626385 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1ad7edd9-fef5-46c3-81d4-1836976d2170 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:41.627285 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1ad7edd9-fef5-46c3-81d4-1836976d2170 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:41.627820 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1ad7edd9-fef5-46c3-81d4-1836976d2170 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:41.691536 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1ad7edd9-fef5-46c3-81d4-1836976d2170 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:41.700082 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1ad7edd9-fef5-46c3-81d4-1836976d2170 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1260 microversion: 2.1 time: 0.085829 Nov 23 04:17:41.705998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 302/542] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:41 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1260 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:41.937701 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0fdf26c5-3be3-4085-b2e1-f488b6365f0b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:41.938218 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0fdf26c5-3be3-4085-b2e1-f488b6365f0b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:41.944052 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0fdf26c5-3be3-4085-b2e1-f488b6365f0b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:41.944496 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0fdf26c5-3be3-4085-b2e1-f488b6365f0b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:41.945267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0fdf26c5-3be3-4085-b2e1-f488b6365f0b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:41.945702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0fdf26c5-3be3-4085-b2e1-f488b6365f0b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:42.089919 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0fdf26c5-3be3-4085-b2e1-f488b6365f0b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:42.098966 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0fdf26c5-3be3-4085-b2e1-f488b6365f0b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:42.100752 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0fdf26c5-3be3-4085-b2e1-f488b6365f0b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:42.102439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0fdf26c5-3be3-4085-b2e1-f488b6365f0b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.168470 Nov 23 04:17:42.102997 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 241/543] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:41 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:42.284991 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2cb0d770-314e-4bae-93be-dc4a41009370 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:42.285630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2cb0d770-314e-4bae-93be-dc4a41009370 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:42.295941 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cb0d770-314e-4bae-93be-dc4a41009370 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:42.296375 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cb0d770-314e-4bae-93be-dc4a41009370 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:42.297204 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cb0d770-314e-4bae-93be-dc4a41009370 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:42.297647 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cb0d770-314e-4bae-93be-dc4a41009370 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:42.438732 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2cb0d770-314e-4bae-93be-dc4a41009370 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:42.447040 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2cb0d770-314e-4bae-93be-dc4a41009370 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.166038 Nov 23 04:17:42.447632 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 303/544] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:42 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:42.465139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-737d60f1-2a05-4860-8cf9-77cce673983a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:42.465870 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-737d60f1-2a05-4860-8cf9-77cce673983a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:42.472112 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-737d60f1-2a05-4860-8cf9-77cce673983a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:42.475761 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-737d60f1-2a05-4860-8cf9-77cce673983a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:42.475761 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-737d60f1-2a05-4860-8cf9-77cce673983a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:42.475761 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-737d60f1-2a05-4860-8cf9-77cce673983a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:42.504626 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-89eaaec2-f445-4dc3-a703-63d4b4a69fd7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:42.505327 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-89eaaec2-f445-4dc3-a703-63d4b4a69fd7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:42.517597 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-89eaaec2-f445-4dc3-a703-63d4b4a69fd7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:42.519523 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-89eaaec2-f445-4dc3-a703-63d4b4a69fd7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:42.520509 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-89eaaec2-f445-4dc3-a703-63d4b4a69fd7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:42.522148 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-89eaaec2-f445-4dc3-a703-63d4b4a69fd7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:42.605591 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-89eaaec2-f445-4dc3-a703-63d4b4a69fd7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:42.614626 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-89eaaec2-f445-4dc3-a703-63d4b4a69fd7 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1472 microversion: 2.1 time: 0.113555 Nov 23 04:17:42.615567 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 304/545] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:42 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1472 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:42.659734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-737d60f1-2a05-4860-8cf9-77cce673983a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:42.667534 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-737d60f1-2a05-4860-8cf9-77cce673983a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.205938 Nov 23 04:17:42.668109 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 242/546] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:42 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:42.717333 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-716a434d-efdc-4343-919a-fe9f87e492fa tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:42.717957 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-716a434d-efdc-4343-919a-fe9f87e492fa tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:42.724723 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-716a434d-efdc-4343-919a-fe9f87e492fa tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:42.725243 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-716a434d-efdc-4343-919a-fe9f87e492fa tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:42.726576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-716a434d-efdc-4343-919a-fe9f87e492fa tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:42.727041 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-716a434d-efdc-4343-919a-fe9f87e492fa tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:42.787422 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-716a434d-efdc-4343-919a-fe9f87e492fa tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:42.795003 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-716a434d-efdc-4343-919a-fe9f87e492fa tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1260 microversion: 2.1 time: 0.081577 Nov 23 04:17:42.795598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 305/547] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:42 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1260 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:43.121057 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1d8028cd-a7d0-4f64-8b17-ea4935ddf301 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:43.121677 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1d8028cd-a7d0-4f64-8b17-ea4935ddf301 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:43.128858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1d8028cd-a7d0-4f64-8b17-ea4935ddf301 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:43.129324 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1d8028cd-a7d0-4f64-8b17-ea4935ddf301 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:43.130293 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1d8028cd-a7d0-4f64-8b17-ea4935ddf301 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:43.130735 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1d8028cd-a7d0-4f64-8b17-ea4935ddf301 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:43.272450 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1d8028cd-a7d0-4f64-8b17-ea4935ddf301 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:43.280895 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1d8028cd-a7d0-4f64-8b17-ea4935ddf301 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:43.282373 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1d8028cd-a7d0-4f64-8b17-ea4935ddf301 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:43.283531 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1d8028cd-a7d0-4f64-8b17-ea4935ddf301 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.166307 Nov 23 04:17:43.284087 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 243/548] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:43 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:43.464318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0407c7de-2ad9-4f94-a21e-5de11a51e4de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:43.464866 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0407c7de-2ad9-4f94-a21e-5de11a51e4de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:43.471132 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0407c7de-2ad9-4f94-a21e-5de11a51e4de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:43.471973 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0407c7de-2ad9-4f94-a21e-5de11a51e4de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:43.472426 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0407c7de-2ad9-4f94-a21e-5de11a51e4de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:43.472854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0407c7de-2ad9-4f94-a21e-5de11a51e4de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:43.629466 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0407c7de-2ad9-4f94-a21e-5de11a51e4de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:43.632216 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2ad48893-cf27-435c-a3a2-0b1e7b0ae8e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:43.633633 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2ad48893-cf27-435c-a3a2-0b1e7b0ae8e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:43.639095 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0407c7de-2ad9-4f94-a21e-5de11a51e4de tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.178760 Nov 23 04:17:43.644184 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2ad48893-cf27-435c-a3a2-0b1e7b0ae8e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:43.645013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2ad48893-cf27-435c-a3a2-0b1e7b0ae8e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:43.645562 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2ad48893-cf27-435c-a3a2-0b1e7b0ae8e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:43.645995 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2ad48893-cf27-435c-a3a2-0b1e7b0ae8e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:43.650296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 306/549] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:43 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:43.683754 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8af54261-0563-4016-b397-446213d21f1c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:43.684371 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8af54261-0563-4016-b397-446213d21f1c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:43.690292 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8af54261-0563-4016-b397-446213d21f1c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:43.690739 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8af54261-0563-4016-b397-446213d21f1c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:43.691697 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8af54261-0563-4016-b397-446213d21f1c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:43.692142 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8af54261-0563-4016-b397-446213d21f1c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:43.718528 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2ad48893-cf27-435c-a3a2-0b1e7b0ae8e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:43.728535 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2ad48893-cf27-435c-a3a2-0b1e7b0ae8e2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1472 microversion: 2.1 time: 0.099808 Nov 23 04:17:43.729125 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 244/550] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:43 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1472 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:43.811932 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bac0b4e1-e48f-466f-bd3d-fc5fdea76d87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:43.812538 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-bac0b4e1-e48f-466f-bd3d-fc5fdea76d87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:43.826782 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bac0b4e1-e48f-466f-bd3d-fc5fdea76d87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:43.827259 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bac0b4e1-e48f-466f-bd3d-fc5fdea76d87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:43.828098 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bac0b4e1-e48f-466f-bd3d-fc5fdea76d87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:43.828506 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bac0b4e1-e48f-466f-bd3d-fc5fdea76d87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:43.833639 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8af54261-0563-4016-b397-446213d21f1c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:43.849414 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8af54261-0563-4016-b397-446213d21f1c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.162472 Nov 23 04:17:43.853053 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 307/551] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:43 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:43.909602 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bac0b4e1-e48f-466f-bd3d-fc5fdea76d87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:43.928368 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bac0b4e1-e48f-466f-bd3d-fc5fdea76d87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1260 microversion: 2.1 time: 0.119897 Nov 23 04:17:43.933624 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 245/552] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:43 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1260 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:44.302490 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e2540984-ee0e-4ccf-a744-cda69372c127 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:44.303099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e2540984-ee0e-4ccf-a744-cda69372c127 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:44.310127 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2540984-ee0e-4ccf-a744-cda69372c127 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:44.310578 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2540984-ee0e-4ccf-a744-cda69372c127 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:44.311395 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2540984-ee0e-4ccf-a744-cda69372c127 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:44.311835 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2540984-ee0e-4ccf-a744-cda69372c127 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:44.453943 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e2540984-ee0e-4ccf-a744-cda69372c127 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:44.462709 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e2540984-ee0e-4ccf-a744-cda69372c127 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:44.464318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e2540984-ee0e-4ccf-a744-cda69372c127 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:44.465588 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e2540984-ee0e-4ccf-a744-cda69372c127 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.166883 Nov 23 04:17:44.466261 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 308/553] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:44 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:44.657817 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4dd25f3c-7539-4f71-84cc-9ee884ce4e9b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:44.658367 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4dd25f3c-7539-4f71-84cc-9ee884ce4e9b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:44.666573 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4dd25f3c-7539-4f71-84cc-9ee884ce4e9b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:44.667090 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4dd25f3c-7539-4f71-84cc-9ee884ce4e9b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:44.667896 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4dd25f3c-7539-4f71-84cc-9ee884ce4e9b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:44.668357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4dd25f3c-7539-4f71-84cc-9ee884ce4e9b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:44.746418 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8ca2112c-7943-4539-b347-f6f9a60268da tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:44.747204 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8ca2112c-7943-4539-b347-f6f9a60268da tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:44.761184 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ca2112c-7943-4539-b347-f6f9a60268da tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:44.761637 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ca2112c-7943-4539-b347-f6f9a60268da tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:44.762434 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ca2112c-7943-4539-b347-f6f9a60268da tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:44.762890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ca2112c-7943-4539-b347-f6f9a60268da tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:44.817615 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4dd25f3c-7539-4f71-84cc-9ee884ce4e9b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:44.826844 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4dd25f3c-7539-4f71-84cc-9ee884ce4e9b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.173165 Nov 23 04:17:44.827761 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 246/554] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:44 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:44.837069 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8ca2112c-7943-4539-b347-f6f9a60268da tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:44.844737 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8ca2112c-7943-4539-b347-f6f9a60268da tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1472 microversion: 2.1 time: 0.103089 Nov 23 04:17:44.845294 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 309/555] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:44 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1472 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:44.861128 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bc30ecd4-391c-4937-b3cc-6bfffbe25ecd tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:44.861730 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-bc30ecd4-391c-4937-b3cc-6bfffbe25ecd tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:44.867789 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bc30ecd4-391c-4937-b3cc-6bfffbe25ecd tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:44.868411 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bc30ecd4-391c-4937-b3cc-6bfffbe25ecd tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:44.869228 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bc30ecd4-391c-4937-b3cc-6bfffbe25ecd tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:44.869661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bc30ecd4-391c-4937-b3cc-6bfffbe25ecd tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:44.946233 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-aa0e7cb3-7a73-4277-9eca-61ab104e1a52 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:44.946921 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-aa0e7cb3-7a73-4277-9eca-61ab104e1a52 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:44.952734 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aa0e7cb3-7a73-4277-9eca-61ab104e1a52 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:44.953216 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aa0e7cb3-7a73-4277-9eca-61ab104e1a52 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:44.953948 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aa0e7cb3-7a73-4277-9eca-61ab104e1a52 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:44.954390 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aa0e7cb3-7a73-4277-9eca-61ab104e1a52 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:45.024539 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-aa0e7cb3-7a73-4277-9eca-61ab104e1a52 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:45.029097 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bc30ecd4-391c-4937-b3cc-6bfffbe25ecd tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:45.032031 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-aa0e7cb3-7a73-4277-9eca-61ab104e1a52 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1260 microversion: 2.1 time: 0.090051 Nov 23 04:17:45.032790 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 310/556] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:44 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1260 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:45.036488 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bc30ecd4-391c-4937-b3cc-6bfffbe25ecd tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.179068 Nov 23 04:17:45.037122 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 247/557] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:44 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:45.492731 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-01804a8a-4fb6-453d-8a54-ac15da8101d9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:45.493342 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-01804a8a-4fb6-453d-8a54-ac15da8101d9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:45.502503 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01804a8a-4fb6-453d-8a54-ac15da8101d9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:45.503104 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01804a8a-4fb6-453d-8a54-ac15da8101d9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:45.504086 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01804a8a-4fb6-453d-8a54-ac15da8101d9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:45.504710 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01804a8a-4fb6-453d-8a54-ac15da8101d9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:45.845315 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fef7833c-8e19-4fc6-87d6-d7a27fbe06ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:45.845854 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fef7833c-8e19-4fc6-87d6-d7a27fbe06ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:45.849605 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-01804a8a-4fb6-453d-8a54-ac15da8101d9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:45.852534 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fef7833c-8e19-4fc6-87d6-d7a27fbe06ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:45.858313 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fef7833c-8e19-4fc6-87d6-d7a27fbe06ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:45.858313 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fef7833c-8e19-4fc6-87d6-d7a27fbe06ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:45.858313 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fef7833c-8e19-4fc6-87d6-d7a27fbe06ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:45.862185 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-01804a8a-4fb6-453d-8a54-ac15da8101d9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:45.865766 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-01804a8a-4fb6-453d-8a54-ac15da8101d9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:45.866686 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-01804a8a-4fb6-453d-8a54-ac15da8101d9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.377719 Nov 23 04:17:45.881369 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 311/558] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:45 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:45.886893 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:45.886893 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:45.893429 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:45.899036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:45.899036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:45.899036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:45.934018 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:45.934566 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:45.935100 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lazy-loading 'fault' on Instance uuid 5694f710-d745-44e4-9b59-55d54a09515d {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:17:45.984959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:45.994318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e1f97e2a-4e60-4a41-a209-40438cfe0041 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 200 len: 1308 microversion: 2.1 time: 0.111779 Nov 23 04:17:45.995021 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 312/559] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:45 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:46.049640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fd63b9c7-c26f-497a-8576-f222ebbd1736 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:46.050616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fd63b9c7-c26f-497a-8576-f222ebbd1736 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:46.056753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fef7833c-8e19-4fc6-87d6-d7a27fbe06ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:46.057097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fd63b9c7-c26f-497a-8576-f222ebbd1736 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:46.057546 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fd63b9c7-c26f-497a-8576-f222ebbd1736 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:46.058385 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fd63b9c7-c26f-497a-8576-f222ebbd1736 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:46.058810 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fd63b9c7-c26f-497a-8576-f222ebbd1736 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:46.066408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fef7833c-8e19-4fc6-87d6-d7a27fbe06ae tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.224741 Nov 23 04:17:46.067388 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 248/560] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:45 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:46.072075 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a14266e9-d55b-4674-807b-b2c9d5076534 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:46.072688 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a14266e9-d55b-4674-807b-b2c9d5076534 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:46.079138 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a14266e9-d55b-4674-807b-b2c9d5076534 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:46.079877 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a14266e9-d55b-4674-807b-b2c9d5076534 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:46.080732 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a14266e9-d55b-4674-807b-b2c9d5076534 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:46.082316 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a14266e9-d55b-4674-807b-b2c9d5076534 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:46.125449 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-fd63b9c7-c26f-497a-8576-f222ebbd1736 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:46.133228 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fd63b9c7-c26f-497a-8576-f222ebbd1736 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1252 microversion: 2.1 time: 0.087175 Nov 23 04:17:46.133821 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 313/561] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:46 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1252 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:46.277362 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a14266e9-d55b-4674-807b-b2c9d5076534 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:46.284609 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a14266e9-d55b-4674-807b-b2c9d5076534 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.216214 Nov 23 04:17:46.285171 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 249/562] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:46 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:46.888451 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9283fdfa-73dc-4c7a-96b6-e3d7b8beb687 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:46.889003 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9283fdfa-73dc-4c7a-96b6-e3d7b8beb687 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:46.895138 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9283fdfa-73dc-4c7a-96b6-e3d7b8beb687 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:46.895614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9283fdfa-73dc-4c7a-96b6-e3d7b8beb687 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:46.896446 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9283fdfa-73dc-4c7a-96b6-e3d7b8beb687 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:46.896839 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9283fdfa-73dc-4c7a-96b6-e3d7b8beb687 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:47.013270 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2d44f762-5bd3-4075-a51c-46250f3b44db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:47.014020 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2d44f762-5bd3-4075-a51c-46250f3b44db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 5694f710-d745-44e4-9b59-55d54a09515d] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:47.020335 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d44f762-5bd3-4075-a51c-46250f3b44db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:47.020787 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d44f762-5bd3-4075-a51c-46250f3b44db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:47.021570 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d44f762-5bd3-4075-a51c-46250f3b44db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:47.022012 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d44f762-5bd3-4075-a51c-46250f3b44db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:47.036245 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-2d44f762-5bd3-4075-a51c-46250f3b44db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] HTTP exception thrown: Instance 5694f710-d745-44e4-9b59-55d54a09515d could not be found. Nov 23 04:17:47.037015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2d44f762-5bd3-4075-a51c-46250f3b44db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Returning 404 to user: Instance 5694f710-d745-44e4-9b59-55d54a09515d could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:17:47.037659 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9283fdfa-73dc-4c7a-96b6-e3d7b8beb687 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:47.037854 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2d44f762-5bd3-4075-a51c-46250f3b44db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d" status: 404 len: 111 microversion: 2.1 time: 0.028342 Nov 23 04:17:47.038861 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 250/563] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:47 2021] GET /compute/v2.1/servers/5694f710-d745-44e4-9b59-55d54a09515d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 04:17:47.047285 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9283fdfa-73dc-4c7a-96b6-e3d7b8beb687 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:47.048645 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9283fdfa-73dc-4c7a-96b6-e3d7b8beb687 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:47.049798 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9283fdfa-73dc-4c7a-96b6-e3d7b8beb687 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.166569 Nov 23 04:17:47.050417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 314/564] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:46 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:47.085481 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a359c6ea-aea1-4a31-be51-07fdfde67f3d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:47.086169 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a359c6ea-aea1-4a31-be51-07fdfde67f3d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:47.092318 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a359c6ea-aea1-4a31-be51-07fdfde67f3d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:47.092773 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a359c6ea-aea1-4a31-be51-07fdfde67f3d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:47.093554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a359c6ea-aea1-4a31-be51-07fdfde67f3d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:47.093993 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a359c6ea-aea1-4a31-be51-07fdfde67f3d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:47.150867 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1872d0ef-71d2-42e0-a85f-5dcfe89bdb9b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:47.151635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1872d0ef-71d2-42e0-a85f-5dcfe89bdb9b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:47.157779 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1872d0ef-71d2-42e0-a85f-5dcfe89bdb9b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:47.158422 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1872d0ef-71d2-42e0-a85f-5dcfe89bdb9b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:47.159297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1872d0ef-71d2-42e0-a85f-5dcfe89bdb9b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:47.159774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1872d0ef-71d2-42e0-a85f-5dcfe89bdb9b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:47.229314 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1872d0ef-71d2-42e0-a85f-5dcfe89bdb9b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:47.237504 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1872d0ef-71d2-42e0-a85f-5dcfe89bdb9b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1308 microversion: 2.1 time: 0.090633 Nov 23 04:17:47.238396 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 315/565] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:47 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:47.256652 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a359c6ea-aea1-4a31-be51-07fdfde67f3d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:47.267131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a359c6ea-aea1-4a31-be51-07fdfde67f3d tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.185351 Nov 23 04:17:47.270900 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 251/566] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:47 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:47.301557 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bb3a87af-27d5-4489-92a0-59029e7d2213 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:47.302157 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bb3a87af-27d5-4489-92a0-59029e7d2213 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:47.308460 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb3a87af-27d5-4489-92a0-59029e7d2213 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:47.308907 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb3a87af-27d5-4489-92a0-59029e7d2213 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:47.309681 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb3a87af-27d5-4489-92a0-59029e7d2213 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:47.310112 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb3a87af-27d5-4489-92a0-59029e7d2213 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:47.443572 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-bb3a87af-27d5-4489-92a0-59029e7d2213 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:47.451938 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bb3a87af-27d5-4489-92a0-59029e7d2213 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1313 microversion: 2.1 time: 0.154065 Nov 23 04:17:47.452530 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 316/567] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:47 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:48.073323 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1a0bf81c-2d54-4490-a8ab-b85e607ca4f1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:48.074052 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1a0bf81c-2d54-4490-a8ab-b85e607ca4f1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:48.081084 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1a0bf81c-2d54-4490-a8ab-b85e607ca4f1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:48.081615 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1a0bf81c-2d54-4490-a8ab-b85e607ca4f1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:48.082501 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1a0bf81c-2d54-4490-a8ab-b85e607ca4f1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:48.083015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1a0bf81c-2d54-4490-a8ab-b85e607ca4f1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:48.253907 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-eb8aacfa-7307-4216-9f86-e3189223a6d0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:48.255328 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-eb8aacfa-7307-4216-9f86-e3189223a6d0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:48.262172 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eb8aacfa-7307-4216-9f86-e3189223a6d0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:48.262721 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eb8aacfa-7307-4216-9f86-e3189223a6d0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:48.263739 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eb8aacfa-7307-4216-9f86-e3189223a6d0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:48.264324 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eb8aacfa-7307-4216-9f86-e3189223a6d0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:48.309468 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1a0bf81c-2d54-4490-a8ab-b85e607ca4f1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:48.322885 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1a0bf81c-2d54-4490-a8ab-b85e607ca4f1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:48.324739 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1a0bf81c-2d54-4490-a8ab-b85e607ca4f1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:48.326543 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1a0bf81c-2d54-4490-a8ab-b85e607ca4f1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.258681 Nov 23 04:17:48.328166 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 252/568] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:48 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:48.345525 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-327051d5-92d6-44e2-b9a5-68d75c6b0331 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:48.345525 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-327051d5-92d6-44e2-b9a5-68d75c6b0331 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:48.348592 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-327051d5-92d6-44e2-b9a5-68d75c6b0331 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:48.349356 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-327051d5-92d6-44e2-b9a5-68d75c6b0331 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:48.351398 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-327051d5-92d6-44e2-b9a5-68d75c6b0331 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:48.353357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-327051d5-92d6-44e2-b9a5-68d75c6b0331 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:48.360635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-eb8aacfa-7307-4216-9f86-e3189223a6d0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:48.368555 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-eb8aacfa-7307-4216-9f86-e3189223a6d0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1314 microversion: 2.1 time: 0.118481 Nov 23 04:17:48.370009 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 317/569] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:48 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1314 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:48.383251 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-facd883e-89d7-4210-95ac-4bca65851eff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:48.384445 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-facd883e-89d7-4210-95ac-4bca65851eff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:48.391477 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-facd883e-89d7-4210-95ac-4bca65851eff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:48.392183 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-facd883e-89d7-4210-95ac-4bca65851eff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:48.393365 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-facd883e-89d7-4210-95ac-4bca65851eff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:48.393954 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-facd883e-89d7-4210-95ac-4bca65851eff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:48.438782 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-facd883e-89d7-4210-95ac-4bca65851eff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:17:48.642619 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-327051d5-92d6-44e2-b9a5-68d75c6b0331 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:48.658551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-327051d5-92d6-44e2-b9a5-68d75c6b0331 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1554 microversion: 2.1 time: 0.328561 Nov 23 04:17:48.669239 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 253/570] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:48 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1554 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:48.675354 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e344478d-00b2-436c-88ac-260d95872dac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:48.676203 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e344478d-00b2-436c-88ac-260d95872dac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:48.682609 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e344478d-00b2-436c-88ac-260d95872dac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:48.683418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e344478d-00b2-436c-88ac-260d95872dac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:48.685426 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e344478d-00b2-436c-88ac-260d95872dac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:48.686156 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e344478d-00b2-436c-88ac-260d95872dac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:48.894640 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e344478d-00b2-436c-88ac-260d95872dac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:48.907896 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e344478d-00b2-436c-88ac-260d95872dac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1498 microversion: 2.1 time: 0.237010 Nov 23 04:17:48.925674 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 254/571] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:48 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1498 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:49.345651 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-073acf91-4518-413a-a568-b46f7ab3fc80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:49.346270 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-073acf91-4518-413a-a568-b46f7ab3fc80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:49.353923 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-073acf91-4518-413a-a568-b46f7ab3fc80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:49.354373 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-073acf91-4518-413a-a568-b46f7ab3fc80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:49.355241 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-073acf91-4518-413a-a568-b46f7ab3fc80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:49.355666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-073acf91-4518-413a-a568-b46f7ab3fc80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:49.394082 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-facd883e-89d7-4210-95ac-4bca65851eff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "DELETE /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 204 len: 0 microversion: 2.1 time: 1.022549 Nov 23 04:17:49.397037 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 318/572] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:17:48 2021] DELETE /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:17:49.401067 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3946f130-c562-4b40-8b13-7d23ed2f9090 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:49.402061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3946f130-c562-4b40-8b13-7d23ed2f9090 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:49.408621 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3946f130-c562-4b40-8b13-7d23ed2f9090 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:49.409339 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3946f130-c562-4b40-8b13-7d23ed2f9090 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:49.410331 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3946f130-c562-4b40-8b13-7d23ed2f9090 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:49.410760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3946f130-c562-4b40-8b13-7d23ed2f9090 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:49.637657 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-073acf91-4518-413a-a568-b46f7ab3fc80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:49.646848 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-073acf91-4518-413a-a568-b46f7ab3fc80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:49.648906 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-073acf91-4518-413a-a568-b46f7ab3fc80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:49.650482 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-073acf91-4518-413a-a568-b46f7ab3fc80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.308574 Nov 23 04:17:49.651644 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 255/573] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:49 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:49.662432 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0f0225f4-fc57-4fcf-b7be-c5a262783e8f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:49.663336 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0f0225f4-fc57-4fcf-b7be-c5a262783e8f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:49.681416 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3946f130-c562-4b40-8b13-7d23ed2f9090 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:49.685388 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f0225f4-fc57-4fcf-b7be-c5a262783e8f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:49.686065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f0225f4-fc57-4fcf-b7be-c5a262783e8f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:49.687774 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f0225f4-fc57-4fcf-b7be-c5a262783e8f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:49.688618 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f0225f4-fc57-4fcf-b7be-c5a262783e8f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:49.689224 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3946f130-c562-4b40-8b13-7d23ed2f9090 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.293394 Nov 23 04:17:49.690742 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 319/574] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:49 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:49.695707 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8ec6c429-dfb8-4f17-a737-e24df9247c34 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:49.696526 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8ec6c429-dfb8-4f17-a737-e24df9247c34 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:49.702639 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ec6c429-dfb8-4f17-a737-e24df9247c34 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:49.703769 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ec6c429-dfb8-4f17-a737-e24df9247c34 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:49.705086 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ec6c429-dfb8-4f17-a737-e24df9247c34 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:49.705670 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ec6c429-dfb8-4f17-a737-e24df9247c34 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:49.922076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0f0225f4-fc57-4fcf-b7be-c5a262783e8f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:49.934666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0f0225f4-fc57-4fcf-b7be-c5a262783e8f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.273026 Nov 23 04:17:49.934666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 256/575] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:49 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:49.934886 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8ec6c429-dfb8-4f17-a737-e24df9247c34 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:49.940002 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8ec6c429-dfb8-4f17-a737-e24df9247c34 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1560 microversion: 2.1 time: 0.248235 Nov 23 04:17:49.940581 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 320/576] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:49 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:50.026887 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d90c4b9b-d806-4dd1-97d6-20394d2f7c1e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:50.027454 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d90c4b9b-d806-4dd1-97d6-20394d2f7c1e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:50.034323 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d90c4b9b-d806-4dd1-97d6-20394d2f7c1e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.034851 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d90c4b9b-d806-4dd1-97d6-20394d2f7c1e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.035832 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d90c4b9b-d806-4dd1-97d6-20394d2f7c1e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.036317 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d90c4b9b-d806-4dd1-97d6-20394d2f7c1e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.123442 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-d90c4b9b-d806-4dd1-97d6-20394d2f7c1e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lazy-loading 'services' on Instance uuid 696e3da2-6fdb-4741-8f4f-fffccaf8d403 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:17:50.158021 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dbac003d-4ce7-43a8-80b7-c7abfb6b179d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:50.158588 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dbac003d-4ce7-43a8-80b7-c7abfb6b179d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:50.164908 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dbac003d-4ce7-43a8-80b7-c7abfb6b179d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.165472 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dbac003d-4ce7-43a8-80b7-c7abfb6b179d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.166486 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dbac003d-4ce7-43a8-80b7-c7abfb6b179d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.167144 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dbac003d-4ce7-43a8-80b7-c7abfb6b179d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.193286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dbac003d-4ce7-43a8-80b7-c7abfb6b179d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:17:50.356575 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d90c4b9b-d806-4dd1-97d6-20394d2f7c1e tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "DELETE /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments/b90a1ac4-8fa1-4bc4-a1bd-cc5efd87b7f3" status: 202 len: 0 microversion: 2.1 time: 0.333223 Nov 23 04:17:50.357509 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 257/577] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:17:50 2021] DELETE /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments/b90a1ac4-8fa1-4bc4-a1bd-cc5efd87b7f3 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:17:50.365410 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-34bd86bd-8969-4a39-826e-58c42ace77c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:50.366460 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-34bd86bd-8969-4a39-826e-58c42ace77c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:50.373643 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-34bd86bd-8969-4a39-826e-58c42ace77c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.374376 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-34bd86bd-8969-4a39-826e-58c42ace77c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.375172 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-34bd86bd-8969-4a39-826e-58c42ace77c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.375801 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-34bd86bd-8969-4a39-826e-58c42ace77c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.407641 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-34bd86bd-8969-4a39-826e-58c42ace77c9 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Nov 23 04:17:50.408221 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 258/578] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:50 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:17:50.537051 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dbac003d-4ce7-43a8-80b7-c7abfb6b179d tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "DELETE /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 204 len: 0 microversion: 2.1 time: 0.382345 Nov 23 04:17:50.538840 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 321/579] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:17:50 2021] DELETE /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 04:17:50.546051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6043e9de-8301-4f02-af01-a5bc8078ef5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:50.547274 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6043e9de-8301-4f02-af01-a5bc8078ef5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:50.552636 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6043e9de-8301-4f02-af01-a5bc8078ef5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.553077 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6043e9de-8301-4f02-af01-a5bc8078ef5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.553851 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6043e9de-8301-4f02-af01-a5bc8078ef5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.554335 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6043e9de-8301-4f02-af01-a5bc8078ef5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.671313 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ca66a2b6-1aa1-4d27-bcff-8bc4387bac11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:50.672294 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ca66a2b6-1aa1-4d27-bcff-8bc4387bac11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:50.685164 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca66a2b6-1aa1-4d27-bcff-8bc4387bac11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.685969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca66a2b6-1aa1-4d27-bcff-8bc4387bac11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.686774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca66a2b6-1aa1-4d27-bcff-8bc4387bac11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.687235 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca66a2b6-1aa1-4d27-bcff-8bc4387bac11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.706104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6043e9de-8301-4f02-af01-a5bc8078ef5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:50.714414 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6043e9de-8301-4f02-af01-a5bc8078ef5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1504 microversion: 2.1 time: 0.171949 Nov 23 04:17:50.715679 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 259/580] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:50 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:50.731779 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d14e1d73-d03c-4390-985a-74da39b2ffd0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:50.732394 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d14e1d73-d03c-4390-985a-74da39b2ffd0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:50.738342 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d14e1d73-d03c-4390-985a-74da39b2ffd0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.738789 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d14e1d73-d03c-4390-985a-74da39b2ffd0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.739794 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d14e1d73-d03c-4390-985a-74da39b2ffd0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.740228 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d14e1d73-d03c-4390-985a-74da39b2ffd0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.881129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ca66a2b6-1aa1-4d27-bcff-8bc4387bac11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:50.890620 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ca66a2b6-1aa1-4d27-bcff-8bc4387bac11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:50.892124 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ca66a2b6-1aa1-4d27-bcff-8bc4387bac11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:50.893326 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ca66a2b6-1aa1-4d27-bcff-8bc4387bac11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.225999 Nov 23 04:17:50.893839 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 322/581] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:50 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:50.929174 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d14e1d73-d03c-4390-985a-74da39b2ffd0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:50.938406 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d14e1d73-d03c-4390-985a-74da39b2ffd0 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.221427 Nov 23 04:17:50.939243 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 260/582] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:50 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:50.948267 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-16c8ffba-376c-478f-9459-ff57ff832e07 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:50.948898 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-16c8ffba-376c-478f-9459-ff57ff832e07 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:50.955130 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-16c8ffba-376c-478f-9459-ff57ff832e07 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.955616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-16c8ffba-376c-478f-9459-ff57ff832e07 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:50.956415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-16c8ffba-376c-478f-9459-ff57ff832e07 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:50.956855 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-16c8ffba-376c-478f-9459-ff57ff832e07 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:51.099058 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-16c8ffba-376c-478f-9459-ff57ff832e07 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:51.107040 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-16c8ffba-376c-478f-9459-ff57ff832e07 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.163192 Nov 23 04:17:51.107674 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 323/583] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:50 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:51.422409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-afe38ae5-04a4-4b22-bc4b-4a0466bb7725 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:51.425581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-afe38ae5-04a4-4b22-bc4b-4a0466bb7725 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:51.436582 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-afe38ae5-04a4-4b22-bc4b-4a0466bb7725 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:51.437034 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-afe38ae5-04a4-4b22-bc4b-4a0466bb7725 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:51.437849 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-afe38ae5-04a4-4b22-bc4b-4a0466bb7725 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:51.438287 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-afe38ae5-04a4-4b22-bc4b-4a0466bb7725 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:51.473581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-afe38ae5-04a4-4b22-bc4b-4a0466bb7725 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052880 Nov 23 04:17:51.473581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 261/584] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:51 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:51.732322 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6d0e68d0-4ec2-4a4c-a566-f11237cb6b4a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:51.732917 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6d0e68d0-4ec2-4a4c-a566-f11237cb6b4a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:51.739380 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6d0e68d0-4ec2-4a4c-a566-f11237cb6b4a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:51.739826 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6d0e68d0-4ec2-4a4c-a566-f11237cb6b4a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:51.740604 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6d0e68d0-4ec2-4a4c-a566-f11237cb6b4a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:51.741038 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6d0e68d0-4ec2-4a4c-a566-f11237cb6b4a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:51.887335 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6d0e68d0-4ec2-4a4c-a566-f11237cb6b4a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:51.894529 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6d0e68d0-4ec2-4a4c-a566-f11237cb6b4a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1504 microversion: 2.1 time: 0.166014 Nov 23 04:17:51.895166 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 324/585] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:51 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:51.912026 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f208fe64-5c70-48e1-94f8-d6b6ac764593 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:51.912629 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f208fe64-5c70-48e1-94f8-d6b6ac764593 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:51.918872 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f208fe64-5c70-48e1-94f8-d6b6ac764593 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:51.919364 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f208fe64-5c70-48e1-94f8-d6b6ac764593 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:51.920142 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f208fe64-5c70-48e1-94f8-d6b6ac764593 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:51.920576 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f208fe64-5c70-48e1-94f8-d6b6ac764593 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:51.956331 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-31e97f58-e742-4a73-a6b4-34a269d56f49 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:51.962115 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-31e97f58-e742-4a73-a6b4-34a269d56f49 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:51.968802 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-31e97f58-e742-4a73-a6b4-34a269d56f49 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:51.969419 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-31e97f58-e742-4a73-a6b4-34a269d56f49 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:51.971726 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-31e97f58-e742-4a73-a6b4-34a269d56f49 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:51.972289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-31e97f58-e742-4a73-a6b4-34a269d56f49 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:52.128909 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f208fe64-5c70-48e1-94f8-d6b6ac764593 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:52.138124 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f208fe64-5c70-48e1-94f8-d6b6ac764593 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:52.140209 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f208fe64-5c70-48e1-94f8-d6b6ac764593 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:52.141370 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f208fe64-5c70-48e1-94f8-d6b6ac764593 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.233002 Nov 23 04:17:52.141967 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 262/586] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:51 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:17:52.146209 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c03c19ba-763f-4fe9-9172-e2774dbc7553 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:52.146806 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c03c19ba-763f-4fe9-9172-e2774dbc7553 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:52.153306 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c03c19ba-763f-4fe9-9172-e2774dbc7553 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:52.154076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c03c19ba-763f-4fe9-9172-e2774dbc7553 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:52.154517 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c03c19ba-763f-4fe9-9172-e2774dbc7553 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:52.154949 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c03c19ba-763f-4fe9-9172-e2774dbc7553 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:52.182922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-31e97f58-e742-4a73-a6b4-34a269d56f49 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:52.200340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-31e97f58-e742-4a73-a6b4-34a269d56f49 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.242083 Nov 23 04:17:52.201091 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 325/587] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:51 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:52.312625 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c03c19ba-763f-4fe9-9172-e2774dbc7553 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:52.320689 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c03c19ba-763f-4fe9-9172-e2774dbc7553 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.177228 Nov 23 04:17:52.322820 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 263/588] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:52 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:52.480741 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-06958fe4-5130-4cab-a1f6-362693934dc4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:52.481884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-06958fe4-5130-4cab-a1f6-362693934dc4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:52.488471 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-06958fe4-5130-4cab-a1f6-362693934dc4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:52.488884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-06958fe4-5130-4cab-a1f6-362693934dc4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:52.489673 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-06958fe4-5130-4cab-a1f6-362693934dc4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:52.490104 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-06958fe4-5130-4cab-a1f6-362693934dc4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:52.521008 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-06958fe4-5130-4cab-a1f6-362693934dc4 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Nov 23 04:17:52.521557 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 326/589] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:52 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:17:52.912152 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-15be2b9e-7942-4f9f-a04c-1921105b290e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:52.913002 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-15be2b9e-7942-4f9f-a04c-1921105b290e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:52.920665 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15be2b9e-7942-4f9f-a04c-1921105b290e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:52.921120 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15be2b9e-7942-4f9f-a04c-1921105b290e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:52.921935 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15be2b9e-7942-4f9f-a04c-1921105b290e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:52.922424 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15be2b9e-7942-4f9f-a04c-1921105b290e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:53.064579 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-15be2b9e-7942-4f9f-a04c-1921105b290e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:53.071924 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-15be2b9e-7942-4f9f-a04c-1921105b290e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1504 microversion: 2.1 time: 0.163347 Nov 23 04:17:53.072552 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 264/590] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:52 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:53.162987 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f6c5e745-58c9-489a-a4ef-302a545e1cb7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:53.164362 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f6c5e745-58c9-489a-a4ef-302a545e1cb7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:53.170810 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f6c5e745-58c9-489a-a4ef-302a545e1cb7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:53.171282 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f6c5e745-58c9-489a-a4ef-302a545e1cb7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:53.172049 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f6c5e745-58c9-489a-a4ef-302a545e1cb7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:53.172474 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f6c5e745-58c9-489a-a4ef-302a545e1cb7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:53.219132 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-78e77366-fa2e-47cf-bfc3-0dc3435d8732 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:53.219792 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-78e77366-fa2e-47cf-bfc3-0dc3435d8732 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:53.225482 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-78e77366-fa2e-47cf-bfc3-0dc3435d8732 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:53.225925 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-78e77366-fa2e-47cf-bfc3-0dc3435d8732 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:53.226721 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-78e77366-fa2e-47cf-bfc3-0dc3435d8732 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:53.227151 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-78e77366-fa2e-47cf-bfc3-0dc3435d8732 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:53.350497 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f6c5e745-58c9-489a-a4ef-302a545e1cb7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:53.360718 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f6c5e745-58c9-489a-a4ef-302a545e1cb7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:53.362475 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f6c5e745-58c9-489a-a4ef-302a545e1cb7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:53.363838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f6c5e745-58c9-489a-a4ef-302a545e1cb7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.204517 Nov 23 04:17:53.364780 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 327/591] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:53 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:53.372444 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-da901913-7544-473d-967f-cded0f129661 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:53.373217 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-da901913-7544-473d-967f-cded0f129661 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:53.380328 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-da901913-7544-473d-967f-cded0f129661 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:53.381018 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-da901913-7544-473d-967f-cded0f129661 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:53.382255 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-da901913-7544-473d-967f-cded0f129661 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:53.384256 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-da901913-7544-473d-967f-cded0f129661 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:53.422168 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-78e77366-fa2e-47cf-bfc3-0dc3435d8732 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:53.430731 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-78e77366-fa2e-47cf-bfc3-0dc3435d8732 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.214697 Nov 23 04:17:53.431699 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 265/592] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:53 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:53.527440 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-da901913-7544-473d-967f-cded0f129661 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:53.532676 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d368b1ba-59a6-4a04-a0a4-8f7def86f753 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:53.533674 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d368b1ba-59a6-4a04-a0a4-8f7def86f753 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:53.534677 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-da901913-7544-473d-967f-cded0f129661 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.168726 Nov 23 04:17:53.535624 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 328/593] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:53 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:53.541082 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d368b1ba-59a6-4a04-a0a4-8f7def86f753 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:53.545061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d368b1ba-59a6-4a04-a0a4-8f7def86f753 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:53.545061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d368b1ba-59a6-4a04-a0a4-8f7def86f753 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:53.545061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d368b1ba-59a6-4a04-a0a4-8f7def86f753 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:53.573632 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d368b1ba-59a6-4a04-a0a4-8f7def86f753 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044678 Nov 23 04:17:53.574210 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 266/594] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:53 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:54.089269 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ed8c396b-3952-4ab5-8f2d-5459d6174ef3 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:54.090008 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ed8c396b-3952-4ab5-8f2d-5459d6174ef3 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:54.096036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed8c396b-3952-4ab5-8f2d-5459d6174ef3 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:54.096480 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed8c396b-3952-4ab5-8f2d-5459d6174ef3 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:54.097259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed8c396b-3952-4ab5-8f2d-5459d6174ef3 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:54.097688 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed8c396b-3952-4ab5-8f2d-5459d6174ef3 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:54.242299 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ed8c396b-3952-4ab5-8f2d-5459d6174ef3 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:54.250320 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ed8c396b-3952-4ab5-8f2d-5459d6174ef3 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1504 microversion: 2.1 time: 0.164690 Nov 23 04:17:54.251112 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 329/595] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:54 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:54.389102 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-39e3a940-2c83-4da1-aadf-011862da812f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:54.389664 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-39e3a940-2c83-4da1-aadf-011862da812f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:54.395788 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-39e3a940-2c83-4da1-aadf-011862da812f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:54.396230 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-39e3a940-2c83-4da1-aadf-011862da812f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:54.396999 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-39e3a940-2c83-4da1-aadf-011862da812f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:54.397426 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-39e3a940-2c83-4da1-aadf-011862da812f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:54.449139 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dfa5e331-2540-42a7-87e7-0f9e1295950c tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:54.449782 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dfa5e331-2540-42a7-87e7-0f9e1295950c tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:54.455993 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dfa5e331-2540-42a7-87e7-0f9e1295950c tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:54.456450 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dfa5e331-2540-42a7-87e7-0f9e1295950c tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:54.457276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dfa5e331-2540-42a7-87e7-0f9e1295950c tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:54.457714 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dfa5e331-2540-42a7-87e7-0f9e1295950c tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:54.566637 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-39e3a940-2c83-4da1-aadf-011862da812f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:54.577912 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-39e3a940-2c83-4da1-aadf-011862da812f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:54.579459 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-39e3a940-2c83-4da1-aadf-011862da812f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:54.580626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-39e3a940-2c83-4da1-aadf-011862da812f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.195263 Nov 23 04:17:54.581185 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 267/596] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:54 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:54.586383 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-787738f8-3e36-4215-ab87-cbafe7f7299b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:54.587244 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-787738f8-3e36-4215-ab87-cbafe7f7299b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:54.593426 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-787738f8-3e36-4215-ab87-cbafe7f7299b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:54.593872 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-787738f8-3e36-4215-ab87-cbafe7f7299b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:54.594784 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-787738f8-3e36-4215-ab87-cbafe7f7299b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:54.595426 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-787738f8-3e36-4215-ab87-cbafe7f7299b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:54.698905 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dfa5e331-2540-42a7-87e7-0f9e1295950c tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:54.706891 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dfa5e331-2540-42a7-87e7-0f9e1295950c tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.262616 Nov 23 04:17:54.707594 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 330/597] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:54 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:54.717393 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8c41dcca-22dd-4cb0-96e4-ebbc046615c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:54.717393 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8c41dcca-22dd-4cb0-96e4-ebbc046615c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:54.720424 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8c41dcca-22dd-4cb0-96e4-ebbc046615c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:54.720940 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8c41dcca-22dd-4cb0-96e4-ebbc046615c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:54.721810 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8c41dcca-22dd-4cb0-96e4-ebbc046615c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:54.722319 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8c41dcca-22dd-4cb0-96e4-ebbc046615c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:54.761115 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8c41dcca-22dd-4cb0-96e4-ebbc046615c0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052388 Nov 23 04:17:54.764926 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 331/598] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:54 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:54.777439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-787738f8-3e36-4215-ab87-cbafe7f7299b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:54.785504 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-787738f8-3e36-4215-ab87-cbafe7f7299b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.203350 Nov 23 04:17:54.786448 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 268/599] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:54 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:55.268318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8b369805-deb9-4eae-8783-0cdd6a471ee0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:55.269064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8b369805-deb9-4eae-8783-0cdd6a471ee0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:55.276480 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b369805-deb9-4eae-8783-0cdd6a471ee0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:55.276930 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b369805-deb9-4eae-8783-0cdd6a471ee0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:55.277761 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b369805-deb9-4eae-8783-0cdd6a471ee0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:55.278254 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b369805-deb9-4eae-8783-0cdd6a471ee0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:55.416569 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8b369805-deb9-4eae-8783-0cdd6a471ee0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:55.426106 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8b369805-deb9-4eae-8783-0cdd6a471ee0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1504 microversion: 2.1 time: 0.161970 Nov 23 04:17:55.426707 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 332/600] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:55 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:55.601494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-edf9126f-7c85-4370-8136-78d5322ebdf4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:55.602505 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-edf9126f-7c85-4370-8136-78d5322ebdf4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:55.610749 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edf9126f-7c85-4370-8136-78d5322ebdf4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:55.611203 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edf9126f-7c85-4370-8136-78d5322ebdf4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:55.612039 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edf9126f-7c85-4370-8136-78d5322ebdf4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:55.612542 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edf9126f-7c85-4370-8136-78d5322ebdf4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:55.725289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b4766a1c-e683-4bf8-8706-e2b30dcedf92 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:55.725929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b4766a1c-e683-4bf8-8706-e2b30dcedf92 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:55.737902 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b4766a1c-e683-4bf8-8706-e2b30dcedf92 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:55.737902 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b4766a1c-e683-4bf8-8706-e2b30dcedf92 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:55.737902 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b4766a1c-e683-4bf8-8706-e2b30dcedf92 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:55.737902 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b4766a1c-e683-4bf8-8706-e2b30dcedf92 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:55.821223 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-edf9126f-7c85-4370-8136-78d5322ebdf4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:55.833528 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-edf9126f-7c85-4370-8136-78d5322ebdf4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:55.834997 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-edf9126f-7c85-4370-8136-78d5322ebdf4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:55.836702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-edf9126f-7c85-4370-8136-78d5322ebdf4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.240284 Nov 23 04:17:55.837325 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 269/601] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:55 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:55.842198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-68713081-ef47-4d0b-9bd0-f565170994b1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:55.842518 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-68713081-ef47-4d0b-9bd0-f565170994b1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:55.848697 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-68713081-ef47-4d0b-9bd0-f565170994b1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:55.849143 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-68713081-ef47-4d0b-9bd0-f565170994b1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:55.849931 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-68713081-ef47-4d0b-9bd0-f565170994b1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:55.850361 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-68713081-ef47-4d0b-9bd0-f565170994b1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:55.887878 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-68713081-ef47-4d0b-9bd0-f565170994b1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049422 Nov 23 04:17:55.888707 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 270/602] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:55 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:17:55.893807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-dc36edee-1ff1-4ec9-9907-2753c4710efd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:55.894403 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-dc36edee-1ff1-4ec9-9907-2753c4710efd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:55.901601 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dc36edee-1ff1-4ec9-9907-2753c4710efd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:55.902069 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dc36edee-1ff1-4ec9-9907-2753c4710efd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:55.902867 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dc36edee-1ff1-4ec9-9907-2753c4710efd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:55.903327 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dc36edee-1ff1-4ec9-9907-2753c4710efd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:55.918449 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b4766a1c-e683-4bf8-8706-e2b30dcedf92 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:55.934092 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b4766a1c-e683-4bf8-8706-e2b30dcedf92 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.212501 Nov 23 04:17:55.934977 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 333/603] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:55 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:56.050805 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-dc36edee-1ff1-4ec9-9907-2753c4710efd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:56.058889 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-dc36edee-1ff1-4ec9-9907-2753c4710efd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.168474 Nov 23 04:17:56.059498 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 271/604] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:55 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:56.443492 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-00c77919-0c4c-4c74-855f-0dac8aab9811 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:56.444084 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-00c77919-0c4c-4c74-855f-0dac8aab9811 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:56.450913 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-00c77919-0c4c-4c74-855f-0dac8aab9811 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:56.451424 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-00c77919-0c4c-4c74-855f-0dac8aab9811 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:56.452208 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-00c77919-0c4c-4c74-855f-0dac8aab9811 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:56.452645 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-00c77919-0c4c-4c74-855f-0dac8aab9811 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:56.597545 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-00c77919-0c4c-4c74-855f-0dac8aab9811 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:56.604999 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-00c77919-0c4c-4c74-855f-0dac8aab9811 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1504 microversion: 2.1 time: 0.165122 Nov 23 04:17:56.605558 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 334/605] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:56 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:56.861387 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d85e4625-d24c-4710-8fc6-909c7e63e3c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:56.861996 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d85e4625-d24c-4710-8fc6-909c7e63e3c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:56.869344 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d85e4625-d24c-4710-8fc6-909c7e63e3c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:56.869787 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d85e4625-d24c-4710-8fc6-909c7e63e3c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:56.870570 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d85e4625-d24c-4710-8fc6-909c7e63e3c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:56.871001 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d85e4625-d24c-4710-8fc6-909c7e63e3c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:56.900114 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bb31f23e-4713-4caf-bb56-5a8a78b376b2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:56.901029 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bb31f23e-4713-4caf-bb56-5a8a78b376b2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:56.907192 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb31f23e-4713-4caf-bb56-5a8a78b376b2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:56.907701 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb31f23e-4713-4caf-bb56-5a8a78b376b2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:56.908494 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb31f23e-4713-4caf-bb56-5a8a78b376b2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:56.908928 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb31f23e-4713-4caf-bb56-5a8a78b376b2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:56.942085 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bb31f23e-4713-4caf-bb56-5a8a78b376b2 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045656 Nov 23 04:17:56.944167 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 335/606] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:56 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:17:56.951695 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-44806b3d-8876-4b30-abf4-e2f14f28c928 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:56.952304 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-44806b3d-8876-4b30-abf4-e2f14f28c928 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:56.959413 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-44806b3d-8876-4b30-abf4-e2f14f28c928 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:56.959886 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-44806b3d-8876-4b30-abf4-e2f14f28c928 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:56.963381 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-44806b3d-8876-4b30-abf4-e2f14f28c928 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:56.963381 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-44806b3d-8876-4b30-abf4-e2f14f28c928 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:57.059332 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d85e4625-d24c-4710-8fc6-909c7e63e3c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:57.067894 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d85e4625-d24c-4710-8fc6-909c7e63e3c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:57.069357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d85e4625-d24c-4710-8fc6-909c7e63e3c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:57.070994 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d85e4625-d24c-4710-8fc6-909c7e63e3c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.212872 Nov 23 04:17:57.071597 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 272/607] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:56 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:57.084167 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-cf3fbc47-2c27-4e7f-bc2d-241a824cf4b4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:57.090503 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-cf3fbc47-2c27-4e7f-bc2d-241a824cf4b4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:57.110142 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cf3fbc47-2c27-4e7f-bc2d-241a824cf4b4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:57.110774 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cf3fbc47-2c27-4e7f-bc2d-241a824cf4b4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:57.111722 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cf3fbc47-2c27-4e7f-bc2d-241a824cf4b4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:57.112113 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cf3fbc47-2c27-4e7f-bc2d-241a824cf4b4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:57.135122 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-44806b3d-8876-4b30-abf4-e2f14f28c928 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:57.160377 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-44806b3d-8876-4b30-abf4-e2f14f28c928 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.212268 Nov 23 04:17:57.164674 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 336/608] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:56 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:57.269681 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-cf3fbc47-2c27-4e7f-bc2d-241a824cf4b4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:57.278724 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-cf3fbc47-2c27-4e7f-bc2d-241a824cf4b4 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.198405 Nov 23 04:17:57.279572 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 273/609] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:57 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:57.622184 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2df98e16-7b7f-400f-9d5b-f749abfa1dde tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:57.623014 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2df98e16-7b7f-400f-9d5b-f749abfa1dde tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:57.638270 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2df98e16-7b7f-400f-9d5b-f749abfa1dde tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:57.638716 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2df98e16-7b7f-400f-9d5b-f749abfa1dde tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:57.639565 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2df98e16-7b7f-400f-9d5b-f749abfa1dde tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:57.639998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2df98e16-7b7f-400f-9d5b-f749abfa1dde tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:57.791847 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2df98e16-7b7f-400f-9d5b-f749abfa1dde tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:57.800247 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2df98e16-7b7f-400f-9d5b-f749abfa1dde tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1504 microversion: 2.1 time: 0.181733 Nov 23 04:17:57.801090 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 337/610] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:57 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:57.953979 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-215a8f8f-ba82-4a0c-9ece-736ee2022c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:57.954939 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-215a8f8f-ba82-4a0c-9ece-736ee2022c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:57.961311 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-215a8f8f-ba82-4a0c-9ece-736ee2022c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:57.961758 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-215a8f8f-ba82-4a0c-9ece-736ee2022c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:57.962526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-215a8f8f-ba82-4a0c-9ece-736ee2022c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:57.962985 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-215a8f8f-ba82-4a0c-9ece-736ee2022c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:57.994112 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-215a8f8f-ba82-4a0c-9ece-736ee2022c6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Nov 23 04:17:57.994863 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 274/611] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:57 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:17:58.088677 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-70a3a744-c586-437f-a6c7-0a4e3df77e9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:58.089196 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-70a3a744-c586-437f-a6c7-0a4e3df77e9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:58.095121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-70a3a744-c586-437f-a6c7-0a4e3df77e9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:58.095595 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-70a3a744-c586-437f-a6c7-0a4e3df77e9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:58.096372 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-70a3a744-c586-437f-a6c7-0a4e3df77e9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:58.096800 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-70a3a744-c586-437f-a6c7-0a4e3df77e9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:58.180259 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9301e5d0-c7f5-47e4-afc3-037aa719492d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:58.181061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9301e5d0-c7f5-47e4-afc3-037aa719492d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:58.187199 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9301e5d0-c7f5-47e4-afc3-037aa719492d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:58.187753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9301e5d0-c7f5-47e4-afc3-037aa719492d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:58.188619 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9301e5d0-c7f5-47e4-afc3-037aa719492d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:58.189120 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9301e5d0-c7f5-47e4-afc3-037aa719492d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:58.240816 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-70a3a744-c586-437f-a6c7-0a4e3df77e9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:58.250253 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-70a3a744-c586-437f-a6c7-0a4e3df77e9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:58.251807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-70a3a744-c586-437f-a6c7-0a4e3df77e9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:58.252955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-70a3a744-c586-437f-a6c7-0a4e3df77e9d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.168267 Nov 23 04:17:58.253516 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 338/612] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:58 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:58.295077 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-52e838bc-38c0-4715-8206-12f81e4287ab tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:58.295880 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-52e838bc-38c0-4715-8206-12f81e4287ab tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:58.301773 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52e838bc-38c0-4715-8206-12f81e4287ab tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:58.302294 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52e838bc-38c0-4715-8206-12f81e4287ab tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:58.303184 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52e838bc-38c0-4715-8206-12f81e4287ab tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:58.303827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52e838bc-38c0-4715-8206-12f81e4287ab tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:58.329488 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9301e5d0-c7f5-47e4-afc3-037aa719492d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:58.337235 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9301e5d0-c7f5-47e4-afc3-037aa719492d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.161441 Nov 23 04:17:58.338418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 275/613] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:58 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:58.434884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-52e838bc-38c0-4715-8206-12f81e4287ab tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:58.442027 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-52e838bc-38c0-4715-8206-12f81e4287ab tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.150777 Nov 23 04:17:58.442613 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 339/614] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:58 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:17:58.817620 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-732f05a5-cdbc-4ef9-88d8-279e6c7bd6a0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:58.818281 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-732f05a5-cdbc-4ef9-88d8-279e6c7bd6a0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:58.826208 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-732f05a5-cdbc-4ef9-88d8-279e6c7bd6a0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:58.826654 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-732f05a5-cdbc-4ef9-88d8-279e6c7bd6a0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:58.827452 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-732f05a5-cdbc-4ef9-88d8-279e6c7bd6a0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:58.827888 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-732f05a5-cdbc-4ef9-88d8-279e6c7bd6a0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:59.005547 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-388b89a5-b931-4979-a371-16a8720a4e68 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:59.006520 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-388b89a5-b931-4979-a371-16a8720a4e68 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:59.013066 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-388b89a5-b931-4979-a371-16a8720a4e68 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:59.013521 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-388b89a5-b931-4979-a371-16a8720a4e68 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:59.014320 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-388b89a5-b931-4979-a371-16a8720a4e68 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:59.014762 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-388b89a5-b931-4979-a371-16a8720a4e68 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:59.045162 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-388b89a5-b931-4979-a371-16a8720a4e68 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Nov 23 04:17:59.045726 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 340/615] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:17:59 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:17:59.052244 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-732f05a5-cdbc-4ef9-88d8-279e6c7bd6a0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:59.060117 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-732f05a5-cdbc-4ef9-88d8-279e6c7bd6a0 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1504 microversion: 2.1 time: 0.246257 Nov 23 04:17:59.060691 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 276/616] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:58 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:59.272410 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-687bf0c8-bfb5-4a7c-bcab-d0bf257b1658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:59.273065 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-687bf0c8-bfb5-4a7c-bcab-d0bf257b1658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:59.279899 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-687bf0c8-bfb5-4a7c-bcab-d0bf257b1658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:59.280350 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-687bf0c8-bfb5-4a7c-bcab-d0bf257b1658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:59.281147 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-687bf0c8-bfb5-4a7c-bcab-d0bf257b1658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:59.281586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-687bf0c8-bfb5-4a7c-bcab-d0bf257b1658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:59.353889 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4edfb2c1-f985-4157-9476-6d6dabb077d4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:59.354595 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4edfb2c1-f985-4157-9476-6d6dabb077d4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:59.361416 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4edfb2c1-f985-4157-9476-6d6dabb077d4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:59.362098 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4edfb2c1-f985-4157-9476-6d6dabb077d4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:59.363338 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4edfb2c1-f985-4157-9476-6d6dabb077d4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:59.363784 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4edfb2c1-f985-4157-9476-6d6dabb077d4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:59.511424 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-687bf0c8-bfb5-4a7c-bcab-d0bf257b1658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:59.520272 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-687bf0c8-bfb5-4a7c-bcab-d0bf257b1658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:59.521764 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-687bf0c8-bfb5-4a7c-bcab-d0bf257b1658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:59.522922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-687bf0c8-bfb5-4a7c-bcab-d0bf257b1658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.254246 Nov 23 04:17:59.523557 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 341/617] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:17:59 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:17:59.527881 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ad9719c3-457d-40d4-8d82-239dd6cc0e9c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:17:59.528520 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ad9719c3-457d-40d4-8d82-239dd6cc0e9c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:17:59.534633 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad9719c3-457d-40d4-8d82-239dd6cc0e9c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:59.535088 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad9719c3-457d-40d4-8d82-239dd6cc0e9c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:59.536119 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad9719c3-457d-40d4-8d82-239dd6cc0e9c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:59.536589 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ad9719c3-457d-40d4-8d82-239dd6cc0e9c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:59.584905 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4edfb2c1-f985-4157-9476-6d6dabb077d4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:59.592674 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4edfb2c1-f985-4157-9476-6d6dabb077d4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.242611 Nov 23 04:17:59.593259 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 277/618] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:59 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:59.722379 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-8ef0bcad-9ea9-4731-bba1-68c54c4623ca req-eb5a1595-372c-46e8-a133-ae9fc3de4127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f1f74c-599b-40e5-aed9-cf063b9c46ac", "tag": "5dc60928-ecbb-432d-abab-7e8074ff19f9"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:17:59.727699 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:17:59.727699 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:17:59.743709 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-8ef0bcad-9ea9-4731-bba1-68c54c4623ca req-eb5a1595-372c-46e8-a133-ae9fc3de4127 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:17:59.744348 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-8ef0bcad-9ea9-4731-bba1-68c54c4623ca req-eb5a1595-372c-46e8-a133-ae9fc3de4127 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:17:59.745289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ad9719c3-457d-40d4-8d82-239dd6cc0e9c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:17:59.760809 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-8ef0bcad-9ea9-4731-bba1-68c54c4623ca req-eb5a1595-372c-46e8-a133-ae9fc3de4127 service nova] Creating event network-changed:5dc60928-ecbb-432d-abab-7e8074ff19f9 for instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac on hv-cinder-76845 Nov 23 04:17:59.761030 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ad9719c3-457d-40d4-8d82-239dd6cc0e9c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.236220 Nov 23 04:17:59.761837 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 342/619] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:17:59 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:17:59.772528 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-8ef0bcad-9ea9-4731-bba1-68c54c4623ca req-eb5a1595-372c-46e8-a133-ae9fc3de4127 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060179 Nov 23 04:17:59.773218 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 278/620] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:17:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:00.057437 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-13d50dfe-56f9-41a6-baf3-c664f6c963a8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:00.058512 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-13d50dfe-56f9-41a6-baf3-c664f6c963a8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:00.064936 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-13d50dfe-56f9-41a6-baf3-c664f6c963a8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:00.065465 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-13d50dfe-56f9-41a6-baf3-c664f6c963a8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:00.066302 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-13d50dfe-56f9-41a6-baf3-c664f6c963a8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:00.066738 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-13d50dfe-56f9-41a6-baf3-c664f6c963a8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:00.077312 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7c65033d-54cf-418a-b2e1-3915f319a799 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:00.077999 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7c65033d-54cf-418a-b2e1-3915f319a799 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:00.084187 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7c65033d-54cf-418a-b2e1-3915f319a799 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:00.084838 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7c65033d-54cf-418a-b2e1-3915f319a799 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:00.086182 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7c65033d-54cf-418a-b2e1-3915f319a799 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:00.086732 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7c65033d-54cf-418a-b2e1-3915f319a799 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:00.099030 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-13d50dfe-56f9-41a6-baf3-c664f6c963a8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046517 Nov 23 04:18:00.099646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 343/621] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:18:00 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:00.250849 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7c65033d-54cf-418a-b2e1-3915f319a799 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:00.258423 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7c65033d-54cf-418a-b2e1-3915f319a799 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1504 microversion: 2.1 time: 0.185394 Nov 23 04:18:00.259032 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 279/622] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:00 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:00.541643 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0798c71c-febf-496f-bd7b-cfb5ac8b55d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:00.542284 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0798c71c-febf-496f-bd7b-cfb5ac8b55d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:00.548128 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0798c71c-febf-496f-bd7b-cfb5ac8b55d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:00.554181 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0798c71c-febf-496f-bd7b-cfb5ac8b55d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:00.554181 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0798c71c-febf-496f-bd7b-cfb5ac8b55d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:00.554181 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0798c71c-febf-496f-bd7b-cfb5ac8b55d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:00.609817 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c2864838-6614-4244-a220-a974ec2f0916 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:00.610450 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c2864838-6614-4244-a220-a974ec2f0916 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:00.616210 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c2864838-6614-4244-a220-a974ec2f0916 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:00.616655 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c2864838-6614-4244-a220-a974ec2f0916 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:00.617573 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c2864838-6614-4244-a220-a974ec2f0916 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:00.617960 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c2864838-6614-4244-a220-a974ec2f0916 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:00.775199 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0798c71c-febf-496f-bd7b-cfb5ac8b55d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:00.783518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0798c71c-febf-496f-bd7b-cfb5ac8b55d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:00.786143 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0798c71c-febf-496f-bd7b-cfb5ac8b55d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:00.786312 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0798c71c-febf-496f-bd7b-cfb5ac8b55d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.249253 Nov 23 04:18:00.787671 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 344/623] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:00 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:18:00.792557 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2d1f7d04-36e0-4ce4-ab86-f575c572731c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:00.793252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2d1f7d04-36e0-4ce4-ab86-f575c572731c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:00.802401 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d1f7d04-36e0-4ce4-ab86-f575c572731c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:00.802851 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d1f7d04-36e0-4ce4-ab86-f575c572731c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:00.803662 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d1f7d04-36e0-4ce4-ab86-f575c572731c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:00.804094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d1f7d04-36e0-4ce4-ab86-f575c572731c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:00.814672 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c2864838-6614-4244-a220-a974ec2f0916 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:00.823456 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c2864838-6614-4244-a220-a974ec2f0916 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.217222 Nov 23 04:18:00.824036 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 280/624] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:00 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:00.937341 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2d1f7d04-36e0-4ce4-ab86-f575c572731c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:00.944703 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2d1f7d04-36e0-4ce4-ab86-f575c572731c tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.156063 Nov 23 04:18:00.946454 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 345/625] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:00 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:01.111674 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ee2920bc-621b-4cbf-b1bd-4676766fdc42 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:01.113254 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ee2920bc-621b-4cbf-b1bd-4676766fdc42 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:01.120102 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ee2920bc-621b-4cbf-b1bd-4676766fdc42 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:01.120551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ee2920bc-621b-4cbf-b1bd-4676766fdc42 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:01.121340 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ee2920bc-621b-4cbf-b1bd-4676766fdc42 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:01.121784 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ee2920bc-621b-4cbf-b1bd-4676766fdc42 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:01.152056 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ee2920bc-621b-4cbf-b1bd-4676766fdc42 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044179 Nov 23 04:18:01.152633 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 281/626] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:18:01 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:18:01.275241 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7f409c28-c1c4-4528-8ab5-c8976b5cedbe tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:01.275855 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7f409c28-c1c4-4528-8ab5-c8976b5cedbe tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:01.281979 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7f409c28-c1c4-4528-8ab5-c8976b5cedbe tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:01.282421 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7f409c28-c1c4-4528-8ab5-c8976b5cedbe tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:01.283203 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7f409c28-c1c4-4528-8ab5-c8976b5cedbe tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:01.283659 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7f409c28-c1c4-4528-8ab5-c8976b5cedbe tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:01.516417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-7f409c28-c1c4-4528-8ab5-c8976b5cedbe tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:01.524899 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7f409c28-c1c4-4528-8ab5-c8976b5cedbe tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1504 microversion: 2.1 time: 0.253429 Nov 23 04:18:01.528536 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 346/627] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:01 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:01.805600 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-aed8d9b0-5b22-4a52-bad7-f99bce26fec7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:01.806269 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-aed8d9b0-5b22-4a52-bad7-f99bce26fec7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:01.812551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-aed8d9b0-5b22-4a52-bad7-f99bce26fec7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:01.812998 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-aed8d9b0-5b22-4a52-bad7-f99bce26fec7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:01.813777 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-aed8d9b0-5b22-4a52-bad7-f99bce26fec7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:01.814208 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-aed8d9b0-5b22-4a52-bad7-f99bce26fec7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:01.842885 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d2f44734-a45e-4c2c-970e-35a9470e4446 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:01.846639 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d2f44734-a45e-4c2c-970e-35a9470e4446 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:01.849938 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d2f44734-a45e-4c2c-970e-35a9470e4446 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:01.850502 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d2f44734-a45e-4c2c-970e-35a9470e4446 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:01.851904 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d2f44734-a45e-4c2c-970e-35a9470e4446 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:01.852348 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d2f44734-a45e-4c2c-970e-35a9470e4446 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:02.190210 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-aed8d9b0-5b22-4a52-bad7-f99bce26fec7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:02.198784 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d2f44734-a45e-4c2c-970e-35a9470e4446 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:02.201273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-aed8d9b0-5b22-4a52-bad7-f99bce26fec7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:02.202765 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-aed8d9b0-5b22-4a52-bad7-f99bce26fec7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:02.204959 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-aed8d9b0-5b22-4a52-bad7-f99bce26fec7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.402260 Nov 23 04:18:02.204959 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 282/628] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:01 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:18:02.209253 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0c914243-e428-4689-b820-0d54836206db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:02.209856 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0c914243-e428-4689-b820-0d54836206db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:02.214976 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d2f44734-a45e-4c2c-970e-35a9470e4446 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.375731 Nov 23 04:18:02.216121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 347/629] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:01 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:02.218045 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0c914243-e428-4689-b820-0d54836206db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:02.219007 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0c914243-e428-4689-b820-0d54836206db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:02.220333 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0c914243-e428-4689-b820-0d54836206db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:02.220987 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0c914243-e428-4689-b820-0d54836206db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:02.221802 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-deef009a-7967-4e16-a725-8fcf5e0e5eb4 req-1a05b218-f4ed-45da-8f74-8acfe7d692f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f26ee12-392f-434a-855d-c0de8604fecc", "name": "network-vif-deleted", "tag": "7939ac63-d4e3-48e0-af74-c5226731ece7"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:02.223841 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:02.223841 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:18:02.233012 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-deef009a-7967-4e16-a725-8fcf5e0e5eb4 req-1a05b218-f4ed-45da-8f74-8acfe7d692f3 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:02.233924 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-deef009a-7967-4e16-a725-8fcf5e0e5eb4 req-1a05b218-f4ed-45da-8f74-8acfe7d692f3 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:02.247590 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-deef009a-7967-4e16-a725-8fcf5e0e5eb4 req-1a05b218-f4ed-45da-8f74-8acfe7d692f3 service nova] Creating event network-vif-deleted:7939ac63-d4e3-48e0-af74-c5226731ece7 for instance 3f26ee12-392f-434a-855d-c0de8604fecc on hv-cinder-76845 Nov 23 04:18:02.252805 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-deef009a-7967-4e16-a725-8fcf5e0e5eb4 req-1a05b218-f4ed-45da-8f74-8acfe7d692f3 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035207 Nov 23 04:18:02.253486 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 348/630] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:02.436022 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0c914243-e428-4689-b820-0d54836206db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:02.443382 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0c914243-e428-4689-b820-0d54836206db tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1512 microversion: 2.1 time: 0.237432 Nov 23 04:18:02.443953 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 283/631] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:02 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:02.543160 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:02.543999 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:02.550238 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:02.550648 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:02.556593 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:02.557039 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:02.594884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:02.595544 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:02.596095 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lazy-loading 'fault' on Instance uuid 3f26ee12-392f-434a-855d-c0de8604fecc {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:18:02.641062 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:02.648530 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-15dbe56b-eda3-4f35-82df-6dc7c2342b9c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 200 len: 1303 microversion: 2.1 time: 0.110194 Nov 23 04:18:02.649289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 349/632] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:02 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:03.224807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-89a57034-644e-4800-aa37-271c1ff55631 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:03.227010 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-89a57034-644e-4800-aa37-271c1ff55631 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:03.234813 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4ed9d17f-6d7b-48f7-aec5-48cba54b8a6a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:03.235725 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4ed9d17f-6d7b-48f7-aec5-48cba54b8a6a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:03.238605 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-89a57034-644e-4800-aa37-271c1ff55631 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.239062 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-89a57034-644e-4800-aa37-271c1ff55631 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.239977 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-89a57034-644e-4800-aa37-271c1ff55631 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.241850 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-89a57034-644e-4800-aa37-271c1ff55631 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.243021 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4ed9d17f-6d7b-48f7-aec5-48cba54b8a6a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.243573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4ed9d17f-6d7b-48f7-aec5-48cba54b8a6a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.244641 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4ed9d17f-6d7b-48f7-aec5-48cba54b8a6a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.245338 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4ed9d17f-6d7b-48f7-aec5-48cba54b8a6a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.447219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4ed9d17f-6d7b-48f7-aec5-48cba54b8a6a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:03.455864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4ed9d17f-6d7b-48f7-aec5-48cba54b8a6a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.223877 Nov 23 04:18:03.455864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 350/633] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:03 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:03.460362 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:03.463712 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-89a57034-644e-4800-aa37-271c1ff55631 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:03.466188 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:03.472236 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.472820 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.472974 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-89a57034-644e-4800-aa37-271c1ff55631 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:03.473522 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.473962 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.474428 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-89a57034-644e-4800-aa37-271c1ff55631 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:03.475624 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-89a57034-644e-4800-aa37-271c1ff55631 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.256101 Nov 23 04:18:03.477134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 284/634] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:03 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:18:03.507803 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.508259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.508704 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lazy-loading 'fault' on Instance uuid cf175718-dca3-4da3-a676-f5d4d54f54e2 {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:18:03.552630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:03.560833 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-04fcd10b-7f9a-46aa-b006-859eb737b85e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 200 len: 1307 microversion: 2.1 time: 0.103789 Nov 23 04:18:03.561398 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 351/635] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:03 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:03.666496 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4df05179-9fb4-4135-aaf8-06a6e1123478 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:03.667340 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4df05179-9fb4-4135-aaf8-06a6e1123478 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 3f26ee12-392f-434a-855d-c0de8604fecc] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:03.673603 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4df05179-9fb4-4135-aaf8-06a6e1123478 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.674059 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4df05179-9fb4-4135-aaf8-06a6e1123478 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.675434 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4df05179-9fb4-4135-aaf8-06a6e1123478 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.676192 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4df05179-9fb4-4135-aaf8-06a6e1123478 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.691223 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-4df05179-9fb4-4135-aaf8-06a6e1123478 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] HTTP exception thrown: Instance 3f26ee12-392f-434a-855d-c0de8604fecc could not be found. Nov 23 04:18:03.692301 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4df05179-9fb4-4135-aaf8-06a6e1123478 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Returning 404 to user: Instance 3f26ee12-392f-434a-855d-c0de8604fecc could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:18:03.693614 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4df05179-9fb4-4135-aaf8-06a6e1123478 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc" status: 404 len: 111 microversion: 2.1 time: 0.032322 Nov 23 04:18:03.694172 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 285/636] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:03 2021] GET /compute/v2.1/servers/3f26ee12-392f-434a-855d-c0de8604fecc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:18:03.739679 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4a62cbc1-c658-4e43-911c-d51b2dfacd12 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:03.742037 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4a62cbc1-c658-4e43-911c-d51b2dfacd12 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:03.746784 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4a62cbc1-c658-4e43-911c-d51b2dfacd12 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.747263 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4a62cbc1-c658-4e43-911c-d51b2dfacd12 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.748056 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4a62cbc1-c658-4e43-911c-d51b2dfacd12 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:03.748495 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4a62cbc1-c658-4e43-911c-d51b2dfacd12 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:03.776052 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4a62cbc1-c658-4e43-911c-d51b2dfacd12 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:18:03.798054 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2115696279", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "networks": [{"uuid": "a4af6b2e-6f38-4592-bab5-e9082b904a73"}]}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:03.851484 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.network.neutron [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] validate_networks() for [('a4af6b2e-6f38-4592-bab5-e9082b904a73', None, None, None, None, None)] {{(pid=116837) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:18:04.102702 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4a62cbc1-c658-4e43-911c-d51b2dfacd12 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "DELETE /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 204 len: 0 microversion: 2.1 time: 0.366337 Nov 23 04:18:04.103435 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 352/637] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:18:03 2021] DELETE /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:18:04.111609 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ff589516-fcba-4362-9caf-c97471ed3ed3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:04.112297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ff589516-fcba-4362-9caf-c97471ed3ed3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:04.118752 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ff589516-fcba-4362-9caf-c97471ed3ed3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.119197 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ff589516-fcba-4362-9caf-c97471ed3ed3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.119999 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ff589516-fcba-4362-9caf-c97471ed3ed3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.120425 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ff589516-fcba-4362-9caf-c97471ed3ed3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.247814 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Flavor limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:18:04.248319 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Image limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:18:04.248704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Flavor pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:18:04.249110 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Image pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:18:04.249547 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:18:04.258578 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.259023 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.259890 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.260326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.276554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Getting quotas for project 78807cb7ca9445b38b7e896adc10ec2b. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:18:04.280603 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Getting quotas for user b20ce08f5765442dbdf399983b8df856 and project 78807cb7ca9445b38b7e896adc10ec2b. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:18:04.291983 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Going to run 1 instances... {{(pid=116837) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:18:04.294355 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:18:04.296689 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ff589516-fcba-4362-9caf-c97471ed3ed3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:04.304057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ff589516-fcba-4362-9caf-c97471ed3ed3 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1507 microversion: 2.1 time: 0.196439 Nov 23 04:18:04.305446 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 353/638] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:04 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:04.309918 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-d758b526-ecbe-4a62-a5c2-5809bbdd8271 req-af83bb05-83e5-4480-b2bd-6b506131661e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf175718-dca3-4da3-a676-f5d4d54f54e2", "name": "network-vif-deleted", "tag": "c6aef10d-8d5c-41bc-b91c-795812fa4860"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:04.311467 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:04.311467 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:18:04.318100 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-d758b526-ecbe-4a62-a5c2-5809bbdd8271 req-af83bb05-83e5-4480-b2bd-6b506131661e service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.318542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-d758b526-ecbe-4a62-a5c2-5809bbdd8271 req-af83bb05-83e5-4480-b2bd-6b506131661e service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.329838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-d758b526-ecbe-4a62-a5c2-5809bbdd8271 req-af83bb05-83e5-4480-b2bd-6b506131661e service nova] Creating event network-vif-deleted:c6aef10d-8d5c-41bc-b91c-795812fa4860 for instance cf175718-dca3-4da3-a676-f5d4d54f54e2 on hv-cinder-76845 Nov 23 04:18:04.334583 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-d758b526-ecbe-4a62-a5c2-5809bbdd8271 req-af83bb05-83e5-4480-b2bd-6b506131661e service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027935 Nov 23 04:18:04.335172 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 354/639] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:04.419294 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9e3e9346-8a9f-4658-bd27-4e538a0df3d4 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624959 Nov 23 04:18:04.419936 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 286/640] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:18:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 04:18:04.431616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-93f0111b-dae3-4514-a1dc-734dda9e3439 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:04.432378 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-93f0111b-dae3-4514-a1dc-734dda9e3439 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:04.471902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d16caf38-ee6c-4a9b-8cef-a7721c1989c8 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:04.472792 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d16caf38-ee6c-4a9b-8cef-a7721c1989c8 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:04.479900 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d16caf38-ee6c-4a9b-8cef-a7721c1989c8 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.480730 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d16caf38-ee6c-4a9b-8cef-a7721c1989c8 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.481529 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d16caf38-ee6c-4a9b-8cef-a7721c1989c8 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.481965 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d16caf38-ee6c-4a9b-8cef-a7721c1989c8 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.485201 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-93f0111b-dae3-4514-a1dc-734dda9e3439 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:04.493836 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-93f0111b-dae3-4514-a1dc-734dda9e3439 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1214 microversion: 2.1 time: 0.067256 Nov 23 04:18:04.494689 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 355/641] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:04 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:04.507839 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-47872fe2-6c55-46cf-80f6-f6b917e6b798 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:04.508777 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-47872fe2-6c55-46cf-80f6-f6b917e6b798 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:04.515910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47872fe2-6c55-46cf-80f6-f6b917e6b798 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.516501 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47872fe2-6c55-46cf-80f6-f6b917e6b798 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.517591 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47872fe2-6c55-46cf-80f6-f6b917e6b798 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.518279 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47872fe2-6c55-46cf-80f6-f6b917e6b798 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.682276 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d16caf38-ee6c-4a9b-8cef-a7721c1989c8 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:04.689752 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d16caf38-ee6c-4a9b-8cef-a7721c1989c8 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.221587 Nov 23 04:18:04.690314 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 287/642] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:04 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:04.694604 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-81caf3b0-13c3-4f26-87bc-3c348a97364b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:04.695395 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-81caf3b0-13c3-4f26-87bc-3c348a97364b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: cf175718-dca3-4da3-a676-f5d4d54f54e2] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:04.701061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-81caf3b0-13c3-4f26-87bc-3c348a97364b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.701963 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-81caf3b0-13c3-4f26-87bc-3c348a97364b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.702428 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-81caf3b0-13c3-4f26-87bc-3c348a97364b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.702860 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-81caf3b0-13c3-4f26-87bc-3c348a97364b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.704320 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-47872fe2-6c55-46cf-80f6-f6b917e6b798 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:04.713090 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-47872fe2-6c55-46cf-80f6-f6b917e6b798 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:04.714601 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-47872fe2-6c55-46cf-80f6-f6b917e6b798 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:04.715790 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-47872fe2-6c55-46cf-80f6-f6b917e6b798 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.220052 Nov 23 04:18:04.716357 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 356/643] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:04 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:18:04.717008 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-81caf3b0-13c3-4f26-87bc-3c348a97364b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] HTTP exception thrown: Instance cf175718-dca3-4da3-a676-f5d4d54f54e2 could not be found. Nov 23 04:18:04.717605 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-81caf3b0-13c3-4f26-87bc-3c348a97364b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Returning 404 to user: Instance cf175718-dca3-4da3-a676-f5d4d54f54e2 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:18:04.718439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-81caf3b0-13c3-4f26-87bc-3c348a97364b tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2" status: 404 len: 111 microversion: 2.1 time: 0.027142 Nov 23 04:18:04.718960 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 288/644] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:04 2021] GET /compute/v2.1/servers/cf175718-dca3-4da3-a676-f5d4d54f54e2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:18:04.726817 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3c93558d-9a91-4991-886a-871725ecb97f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:04.727704 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3c93558d-9a91-4991-886a-871725ecb97f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:04.733398 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c93558d-9a91-4991-886a-871725ecb97f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.733843 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c93558d-9a91-4991-886a-871725ecb97f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.734618 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c93558d-9a91-4991-886a-871725ecb97f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:04.735050 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3c93558d-9a91-4991-886a-871725ecb97f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:04.760567 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3c93558d-9a91-4991-886a-871725ecb97f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:18:05.059152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3c93558d-9a91-4991-886a-871725ecb97f tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "DELETE /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 204 len: 0 microversion: 2.1 time: 0.335923 Nov 23 04:18:05.062605 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 357/645] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:18:04 2021] DELETE /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 04:18:05.067320 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fc0609a6-f368-45de-96d2-5740703197ef tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:05.067976 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fc0609a6-f368-45de-96d2-5740703197ef tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:05.074335 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fc0609a6-f368-45de-96d2-5740703197ef tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.074777 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fc0609a6-f368-45de-96d2-5740703197ef tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.075574 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fc0609a6-f368-45de-96d2-5740703197ef tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.075999 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fc0609a6-f368-45de-96d2-5740703197ef tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.207117 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fc0609a6-f368-45de-96d2-5740703197ef tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:05.215235 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fc0609a6-f368-45de-96d2-5740703197ef tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1513 microversion: 2.1 time: 0.151404 Nov 23 04:18:05.215818 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 289/646] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:05 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:05.327774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8d7cc78c-2d02-4134-a425-7dcc320f27a1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:05.327774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8d7cc78c-2d02-4134-a425-7dcc320f27a1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:05.330158 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8d7cc78c-2d02-4134-a425-7dcc320f27a1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.330602 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8d7cc78c-2d02-4134-a425-7dcc320f27a1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.331418 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8d7cc78c-2d02-4134-a425-7dcc320f27a1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.331854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8d7cc78c-2d02-4134-a425-7dcc320f27a1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.471889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8d7cc78c-2d02-4134-a425-7dcc320f27a1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:05.480003 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8d7cc78c-2d02-4134-a425-7dcc320f27a1 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1507 microversion: 2.1 time: 0.161273 Nov 23 04:18:05.480723 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 358/647] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:05 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:05.507292 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-5e144589-6015-4f2e-8197-113ccf2b3620 req-5fe9b236-d93d-47fc-845b-9871751579c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c13d4db-587d-4d4e-b8cc-23632d768572", "name": "network-vif-plugged", "status": "completed", "tag": "1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:05.509702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:05.509702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:18:05.512767 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fa8583f2-0082-4fad-ba20-23c8c0f3cf4e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:05.513484 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fa8583f2-0082-4fad-ba20-23c8c0f3cf4e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:05.517350 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-5e144589-6015-4f2e-8197-113ccf2b3620 req-5fe9b236-d93d-47fc-845b-9871751579c1 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.517791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-5e144589-6015-4f2e-8197-113ccf2b3620 req-5fe9b236-d93d-47fc-845b-9871751579c1 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.519381 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fa8583f2-0082-4fad-ba20-23c8c0f3cf4e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.519833 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fa8583f2-0082-4fad-ba20-23c8c0f3cf4e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.520616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fa8583f2-0082-4fad-ba20-23c8c0f3cf4e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.521051 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fa8583f2-0082-4fad-ba20-23c8c0f3cf4e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.529005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-5e144589-6015-4f2e-8197-113ccf2b3620 req-5fe9b236-d93d-47fc-845b-9871751579c1 service nova] Creating event network-vif-plugged:1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2 for instance 8c13d4db-587d-4d4e-b8cc-23632d768572 on hv-cinder-76845 Nov 23 04:18:05.533980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-5e144589-6015-4f2e-8197-113ccf2b3620 req-5fe9b236-d93d-47fc-845b-9871751579c1 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036200 Nov 23 04:18:05.535628 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 290/648] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:05.582087 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-fa8583f2-0082-4fad-ba20-23c8c0f3cf4e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:05.590565 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fa8583f2-0082-4fad-ba20-23c8c0f3cf4e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1218 microversion: 2.1 time: 0.083495 Nov 23 04:18:05.591441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 359/649] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:05 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:05.707720 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-282aa63f-8e81-4cab-ad6c-6c5821e497fe tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:05.708514 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-282aa63f-8e81-4cab-ad6c-6c5821e497fe tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:05.715582 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-282aa63f-8e81-4cab-ad6c-6c5821e497fe tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.716135 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-282aa63f-8e81-4cab-ad6c-6c5821e497fe tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.716996 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-282aa63f-8e81-4cab-ad6c-6c5821e497fe tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.717531 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-282aa63f-8e81-4cab-ad6c-6c5821e497fe tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.733934 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8b44b723-62e0-4060-90cf-300796bfe09d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:05.735240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8b44b723-62e0-4060-90cf-300796bfe09d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:05.742760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b44b723-62e0-4060-90cf-300796bfe09d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.743205 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b44b723-62e0-4060-90cf-300796bfe09d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.751378 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b44b723-62e0-4060-90cf-300796bfe09d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:05.752038 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b44b723-62e0-4060-90cf-300796bfe09d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:05.924816 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-282aa63f-8e81-4cab-ad6c-6c5821e497fe tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:05.932437 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-282aa63f-8e81-4cab-ad6c-6c5821e497fe tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.229048 Nov 23 04:18:05.933010 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 291/650] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:05 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:05.937240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8b44b723-62e0-4060-90cf-300796bfe09d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:05.946091 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8b44b723-62e0-4060-90cf-300796bfe09d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:05.947589 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8b44b723-62e0-4060-90cf-300796bfe09d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:05.948722 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8b44b723-62e0-4060-90cf-300796bfe09d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.218670 Nov 23 04:18:05.949273 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 360/651] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:05 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:18:06.232743 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c08d75c0-6d55-4759-88f8-b6390fe96a99 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:06.233283 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c08d75c0-6d55-4759-88f8-b6390fe96a99 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:06.239058 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c08d75c0-6d55-4759-88f8-b6390fe96a99 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:06.242913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c08d75c0-6d55-4759-88f8-b6390fe96a99 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:06.242913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c08d75c0-6d55-4759-88f8-b6390fe96a99 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:06.242913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c08d75c0-6d55-4759-88f8-b6390fe96a99 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:06.396131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c08d75c0-6d55-4759-88f8-b6390fe96a99 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:06.403468 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c08d75c0-6d55-4759-88f8-b6390fe96a99 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1513 microversion: 2.1 time: 0.174368 Nov 23 04:18:06.404151 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 292/652] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:06 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:06.496484 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ef983757-cc23-4141-a9c4-7d581a26b452 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:06.497091 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ef983757-cc23-4141-a9c4-7d581a26b452 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:06.502789 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ef983757-cc23-4141-a9c4-7d581a26b452 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:06.503259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ef983757-cc23-4141-a9c4-7d581a26b452 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:06.504033 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ef983757-cc23-4141-a9c4-7d581a26b452 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:06.506182 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ef983757-cc23-4141-a9c4-7d581a26b452 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:06.607375 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-52565087-f634-4cce-9084-16513a9b6d5c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:06.607982 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-52565087-f634-4cce-9084-16513a9b6d5c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:06.614078 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52565087-f634-4cce-9084-16513a9b6d5c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:06.614533 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52565087-f634-4cce-9084-16513a9b6d5c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:06.615393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52565087-f634-4cce-9084-16513a9b6d5c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:06.615824 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52565087-f634-4cce-9084-16513a9b6d5c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:06.634640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ef983757-cc23-4141-a9c4-7d581a26b452 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:06.641857 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ef983757-cc23-4141-a9c4-7d581a26b452 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1507 microversion: 2.1 time: 0.148968 Nov 23 04:18:06.642422 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 361/653] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:06 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:06.676197 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-52565087-f634-4cce-9084-16513a9b6d5c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:06.683930 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-52565087-f634-4cce-9084-16513a9b6d5c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1266 microversion: 2.1 time: 0.080173 Nov 23 04:18:06.684495 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 293/654] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:06 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:06.949232 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1cb486b4-942e-4b49-b484-6dc7d8677c35 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:06.949753 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1cb486b4-942e-4b49-b484-6dc7d8677c35 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:06.956152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1cb486b4-942e-4b49-b484-6dc7d8677c35 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:06.956595 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1cb486b4-942e-4b49-b484-6dc7d8677c35 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:06.957368 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1cb486b4-942e-4b49-b484-6dc7d8677c35 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:06.957799 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1cb486b4-942e-4b49-b484-6dc7d8677c35 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:06.965810 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ac7bea01-6e97-425b-8e70-d5e9e7a487bd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:06.966511 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ac7bea01-6e97-425b-8e70-d5e9e7a487bd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:06.972599 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ac7bea01-6e97-425b-8e70-d5e9e7a487bd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:06.973151 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ac7bea01-6e97-425b-8e70-d5e9e7a487bd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:06.974020 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ac7bea01-6e97-425b-8e70-d5e9e7a487bd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:06.984719 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ac7bea01-6e97-425b-8e70-d5e9e7a487bd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:07.186177 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1cb486b4-942e-4b49-b484-6dc7d8677c35 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:07.193407 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1cb486b4-942e-4b49-b484-6dc7d8677c35 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.248301 Nov 23 04:18:07.194221 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 362/655] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:06 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:07.217365 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ac7bea01-6e97-425b-8e70-d5e9e7a487bd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:07.230113 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ac7bea01-6e97-425b-8e70-d5e9e7a487bd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:07.231640 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ac7bea01-6e97-425b-8e70-d5e9e7a487bd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:07.232860 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ac7bea01-6e97-425b-8e70-d5e9e7a487bd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.270810 Nov 23 04:18:07.233587 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 294/656] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:06 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:18:07.423751 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b0cb1ede-b55b-456a-ac97-443d79b0ebee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:07.424657 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b0cb1ede-b55b-456a-ac97-443d79b0ebee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:07.432660 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b0cb1ede-b55b-456a-ac97-443d79b0ebee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:07.433310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b0cb1ede-b55b-456a-ac97-443d79b0ebee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:07.434136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b0cb1ede-b55b-456a-ac97-443d79b0ebee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:07.434640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b0cb1ede-b55b-456a-ac97-443d79b0ebee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:07.549804 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-3144f420-d410-4a71-954e-2a21c65cd9b5 req-2be59b4e-446c-4f9e-99ab-14a0509a7fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f1f74c-599b-40e5-aed9-cf063b9c46ac", "name": "network-vif-plugged", "status": "completed", "tag": "5dc60928-ecbb-432d-abab-7e8074ff19f9"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:07.551409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:07.551409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:18:07.559575 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-3144f420-d410-4a71-954e-2a21c65cd9b5 req-2be59b4e-446c-4f9e-99ab-14a0509a7fd5 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:07.560386 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-3144f420-d410-4a71-954e-2a21c65cd9b5 req-2be59b4e-446c-4f9e-99ab-14a0509a7fd5 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:07.572268 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-3144f420-d410-4a71-954e-2a21c65cd9b5 req-2be59b4e-446c-4f9e-99ab-14a0509a7fd5 service nova] Creating event network-vif-plugged:5dc60928-ecbb-432d-abab-7e8074ff19f9 for instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac on hv-cinder-76845 Nov 23 04:18:07.577192 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-3144f420-d410-4a71-954e-2a21c65cd9b5 req-2be59b4e-446c-4f9e-99ab-14a0509a7fd5 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 Nov 23 04:18:07.577971 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 295/657] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:18:07.659899 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-37b39130-f7cd-414f-b809-be6d6bfb4e6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:07.661259 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-37b39130-f7cd-414f-b809-be6d6bfb4e6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:07.676449 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-37b39130-f7cd-414f-b809-be6d6bfb4e6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:07.676913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-37b39130-f7cd-414f-b809-be6d6bfb4e6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:07.677745 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-37b39130-f7cd-414f-b809-be6d6bfb4e6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:07.678210 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-37b39130-f7cd-414f-b809-be6d6bfb4e6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:07.698673 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b0cb1ede-b55b-456a-ac97-443d79b0ebee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:07.706127 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b0cb1ede-b55b-456a-ac97-443d79b0ebee tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1513 microversion: 2.1 time: 0.289088 Nov 23 04:18:07.706702 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 363/658] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:07 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1513 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:07.711686 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-287e7679-5774-415c-add2-d1371d34e4d8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:07.712445 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-287e7679-5774-415c-add2-d1371d34e4d8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:07.720696 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-287e7679-5774-415c-add2-d1371d34e4d8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:07.721374 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-287e7679-5774-415c-add2-d1371d34e4d8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:07.722275 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-287e7679-5774-415c-add2-d1371d34e4d8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:07.722931 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-287e7679-5774-415c-add2-d1371d34e4d8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:07.830750 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-287e7679-5774-415c-add2-d1371d34e4d8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:07.839647 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-287e7679-5774-415c-add2-d1371d34e4d8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1272 microversion: 2.1 time: 0.131698 Nov 23 04:18:07.840227 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 364/659] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:07 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:08.080291 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-37b39130-f7cd-414f-b809-be6d6bfb4e6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:08.091427 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-37b39130-f7cd-414f-b809-be6d6bfb4e6b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1507 microversion: 2.1 time: 0.435855 Nov 23 04:18:08.101654 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 296/660] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:07 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:08.210094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ae6e4d20-a195-43d2-b39d-4d6e441be689 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:08.211425 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ae6e4d20-a195-43d2-b39d-4d6e441be689 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:08.220002 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae6e4d20-a195-43d2-b39d-4d6e441be689 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:08.220544 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae6e4d20-a195-43d2-b39d-4d6e441be689 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:08.221396 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae6e4d20-a195-43d2-b39d-4d6e441be689 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:08.221947 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae6e4d20-a195-43d2-b39d-4d6e441be689 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:08.252502 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-25bd51a6-a2b8-4c4c-a65c-47b0b8e77592 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:08.253440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-25bd51a6-a2b8-4c4c-a65c-47b0b8e77592 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:08.263371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-25bd51a6-a2b8-4c4c-a65c-47b0b8e77592 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:08.263371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-25bd51a6-a2b8-4c4c-a65c-47b0b8e77592 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:08.263702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-25bd51a6-a2b8-4c4c-a65c-47b0b8e77592 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:08.264178 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-25bd51a6-a2b8-4c4c-a65c-47b0b8e77592 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:08.861108 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ae6e4d20-a195-43d2-b39d-4d6e441be689 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:08.870483 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-25bd51a6-a2b8-4c4c-a65c-47b0b8e77592 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:08.881903 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ae6e4d20-a195-43d2-b39d-4d6e441be689 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.674682 Nov 23 04:18:08.893211 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 365/661] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:08 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:08.899008 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-25bd51a6-a2b8-4c4c-a65c-47b0b8e77592 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:08.900805 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-25bd51a6-a2b8-4c4c-a65c-47b0b8e77592 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:08.901497 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-04ef0531-068c-4685-9fc5-22bb4c37dbc9 req-aef2838b-de04-46d2-9e49-af4132e96c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6648b45-9a0f-4dd2-8a71-d53921d23d91", "name": "network-vif-deleted", "tag": "6a7ea38e-87d3-4079-a13a-d1258a7c04f9"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:08.902456 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-25bd51a6-a2b8-4c4c-a65c-47b0b8e77592 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.655453 Nov 23 04:18:08.903123 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:08.903123 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:18:08.916079 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 297/662] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:08 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:18:08.920212 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-04ef0531-068c-4685-9fc5-22bb4c37dbc9 req-aef2838b-de04-46d2-9e49-af4132e96c5a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:08.927798 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-04ef0531-068c-4685-9fc5-22bb4c37dbc9 req-aef2838b-de04-46d2-9e49-af4132e96c5a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:08.928375 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0508ae5d-dbd5-413a-ad81-1a7d52b59f84 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:08.928375 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0508ae5d-dbd5-413a-ad81-1a7d52b59f84 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:08.935757 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0508ae5d-dbd5-413a-ad81-1a7d52b59f84 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:08.936220 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0508ae5d-dbd5-413a-ad81-1a7d52b59f84 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:08.936479 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-04ef0531-068c-4685-9fc5-22bb4c37dbc9 req-aef2838b-de04-46d2-9e49-af4132e96c5a service nova] Creating event network-vif-deleted:6a7ea38e-87d3-4079-a13a-d1258a7c04f9 for instance e6648b45-9a0f-4dd2-8a71-d53921d23d91 on hv-cinder-76845 Nov 23 04:18:08.937050 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0508ae5d-dbd5-413a-ad81-1a7d52b59f84 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:08.938807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0508ae5d-dbd5-413a-ad81-1a7d52b59f84 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:08.942483 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-04ef0531-068c-4685-9fc5-22bb4c37dbc9 req-aef2838b-de04-46d2-9e49-af4132e96c5a service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057134 Nov 23 04:18:08.945483 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 366/663] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:08.955620 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-97a76a61-10bd-4f92-a0ee-4e2253a5b749 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:08.956525 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-97a76a61-10bd-4f92-a0ee-4e2253a5b749 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:08.964414 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-97a76a61-10bd-4f92-a0ee-4e2253a5b749 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:08.965115 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-97a76a61-10bd-4f92-a0ee-4e2253a5b749 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:08.966061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-97a76a61-10bd-4f92-a0ee-4e2253a5b749 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:08.966631 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-97a76a61-10bd-4f92-a0ee-4e2253a5b749 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:09.066618 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0508ae5d-dbd5-413a-ad81-1a7d52b59f84 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:09.075623 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0508ae5d-dbd5-413a-ad81-1a7d52b59f84 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1471 microversion: 2.1 time: 0.158266 Nov 23 04:18:09.076951 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 298/664] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:08 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:09.082661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-0e2286e7-f541-4573-9a66-151a5da45c98 req-f9079a66-3fce-4a82-9a65-0284f5e916eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b618a52-9e4c-43d1-8b3d-97412bd51aed", "name": "network-vif-deleted", "tag": "070ef4fa-f032-4309-bfe7-5f82f3d8a95a"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:09.084574 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:09.084574 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:18:09.094062 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-0e2286e7-f541-4573-9a66-151a5da45c98 req-f9079a66-3fce-4a82-9a65-0284f5e916eb service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:09.094649 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-0e2286e7-f541-4573-9a66-151a5da45c98 req-f9079a66-3fce-4a82-9a65-0284f5e916eb service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:09.108021 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-0e2286e7-f541-4573-9a66-151a5da45c98 req-f9079a66-3fce-4a82-9a65-0284f5e916eb service nova] Creating event network-vif-deleted:070ef4fa-f032-4309-bfe7-5f82f3d8a95a for instance 1b618a52-9e4c-43d1-8b3d-97412bd51aed on hv-cinder-76845 Nov 23 04:18:09.113622 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-0e2286e7-f541-4573-9a66-151a5da45c98 req-f9079a66-3fce-4a82-9a65-0284f5e916eb service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034469 Nov 23 04:18:09.114340 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 299/665] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:09.120025 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:09.120875 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:09.128239 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:09.128835 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:09.129627 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:09.130135 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:09.166404 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:09.166971 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:09.167533 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lazy-loading 'fault' on Instance uuid e6648b45-9a0f-4dd2-8a71-d53921d23d91 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:18:09.193951 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-97a76a61-10bd-4f92-a0ee-4e2253a5b749 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:09.201315 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-97a76a61-10bd-4f92-a0ee-4e2253a5b749 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1314 microversion: 2.1 time: 0.250659 Nov 23 04:18:09.201887 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 367/666] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:08 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:09.216065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:09.223264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-75bc9fca-0cb2-418a-bddf-bb0a42ed7b49 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 200 len: 1312 microversion: 2.1 time: 0.107677 Nov 23 04:18:09.223968 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 300/667] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:09 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:09.900721 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b72965c5-a7b7-48aa-bc89-8f65fed90fe3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:09.901336 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b72965c5-a7b7-48aa-bc89-8f65fed90fe3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:09.907777 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b72965c5-a7b7-48aa-bc89-8f65fed90fe3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:09.908234 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b72965c5-a7b7-48aa-bc89-8f65fed90fe3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:09.909017 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b72965c5-a7b7-48aa-bc89-8f65fed90fe3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:09.909450 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b72965c5-a7b7-48aa-bc89-8f65fed90fe3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:09.921417 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2f7342f9-db8f-4405-b341-e9a72a175b04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:09.922610 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2f7342f9-db8f-4405-b341-e9a72a175b04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:09.930524 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2f7342f9-db8f-4405-b341-e9a72a175b04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:09.931257 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2f7342f9-db8f-4405-b341-e9a72a175b04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:09.932228 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2f7342f9-db8f-4405-b341-e9a72a175b04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:09.932830 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2f7342f9-db8f-4405-b341-e9a72a175b04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.144710 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b72965c5-a7b7-48aa-bc89-8f65fed90fe3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:10.152970 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b72965c5-a7b7-48aa-bc89-8f65fed90fe3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1356 microversion: 2.1 time: 0.256153 Nov 23 04:18:10.162781 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 368/668] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:09 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1356 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:10.169328 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:10.170300 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:10.177070 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.177732 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.178791 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.180841 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.212834 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2f7342f9-db8f-4405-b341-e9a72a175b04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:10.215895 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.216497 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.217039 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lazy-loading 'fault' on Instance uuid 1b618a52-9e4c-43d1-8b3d-97412bd51aed {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:18:10.223279 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2f7342f9-db8f-4405-b341-e9a72a175b04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:10.224851 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2f7342f9-db8f-4405-b341-e9a72a175b04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:10.226735 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2f7342f9-db8f-4405-b341-e9a72a175b04 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1804 microversion: 2.20 time: 0.308333 Nov 23 04:18:10.228074 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 301/669] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:09 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1804 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:18:10.232627 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fb5d1bf6-3e40-4671-a1a0-d67843fcccc8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:10.233308 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fb5d1bf6-3e40-4671-a1a0-d67843fcccc8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:10.240693 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fb5d1bf6-3e40-4671-a1a0-d67843fcccc8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.240979 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fb5d1bf6-3e40-4671-a1a0-d67843fcccc8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.242629 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fb5d1bf6-3e40-4671-a1a0-d67843fcccc8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.243243 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fb5d1bf6-3e40-4671-a1a0-d67843fcccc8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.282491 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:10.290458 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-87403184-1eee-454c-b5b1-1397294b07fd tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 200 len: 1308 microversion: 2.1 time: 0.124988 Nov 23 04:18:10.291093 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 369/670] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:10 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 1308 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:10.295584 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-76b03f38-137c-4b36-8c18-768768c46745 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:10.296183 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-76b03f38-137c-4b36-8c18-768768c46745 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: e6648b45-9a0f-4dd2-8a71-d53921d23d91] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:10.302089 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76b03f38-137c-4b36-8c18-768768c46745 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.302613 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76b03f38-137c-4b36-8c18-768768c46745 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.303488 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76b03f38-137c-4b36-8c18-768768c46745 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.304084 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76b03f38-137c-4b36-8c18-768768c46745 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.318118 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-76b03f38-137c-4b36-8c18-768768c46745 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] HTTP exception thrown: Instance e6648b45-9a0f-4dd2-8a71-d53921d23d91 could not be found. Nov 23 04:18:10.318702 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-76b03f38-137c-4b36-8c18-768768c46745 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Returning 404 to user: Instance e6648b45-9a0f-4dd2-8a71-d53921d23d91 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:18:10.320235 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-76b03f38-137c-4b36-8c18-768768c46745 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91" status: 404 len: 111 microversion: 2.1 time: 0.027533 Nov 23 04:18:10.320708 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 370/671] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:10 2021] GET /compute/v2.1/servers/e6648b45-9a0f-4dd2-8a71-d53921d23d91 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:18:10.328312 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2cbb6695-03a2-4873-9d38-fe62fa90a9e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:10.328792 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2cbb6695-03a2-4873-9d38-fe62fa90a9e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:10.334611 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cbb6695-03a2-4873-9d38-fe62fa90a9e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.335041 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cbb6695-03a2-4873-9d38-fe62fa90a9e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.336397 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cbb6695-03a2-4873-9d38-fe62fa90a9e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.336826 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cbb6695-03a2-4873-9d38-fe62fa90a9e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.363650 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2cbb6695-03a2-4873-9d38-fe62fa90a9e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:18:10.384176 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fb5d1bf6-3e40-4671-a1a0-d67843fcccc8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:10.397610 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fb5d1bf6-3e40-4671-a1a0-d67843fcccc8 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1314 microversion: 2.1 time: 0.168143 Nov 23 04:18:10.399426 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 302/672] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:10 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:10.702652 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2cbb6695-03a2-4873-9d38-fe62fa90a9e8 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "DELETE /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 204 len: 0 microversion: 2.1 time: 0.377501 Nov 23 04:18:10.703364 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 371/673] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:18:10 2021] DELETE /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 23 04:18:10.711138 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e2a475dc-65c5-4e04-8c44-9737d544044b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:10.711853 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e2a475dc-65c5-4e04-8c44-9737d544044b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:10.717770 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e2a475dc-65c5-4e04-8c44-9737d544044b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.722902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e2a475dc-65c5-4e04-8c44-9737d544044b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.722902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e2a475dc-65c5-4e04-8c44-9737d544044b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:10.722902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e2a475dc-65c5-4e04-8c44-9737d544044b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:10.888867 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e2a475dc-65c5-4e04-8c44-9737d544044b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:10.896126 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e2a475dc-65c5-4e04-8c44-9737d544044b tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.188771 Nov 23 04:18:10.896694 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 303/674] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:10 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:11.128890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-d608a5fa-9e79-42c2-bd72-e9f9cb259f22 req-9e1a07ce-e685-4b5e-aa2a-dc04f218e29c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f420c68-9a99-44d2-87e9-9761a71b6e99", "tag": "58fa352a-6445-4306-b684-412b97a2e21a"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:11.130517 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:11.130517 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:18:11.138432 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-d608a5fa-9e79-42c2-bd72-e9f9cb259f22 req-9e1a07ce-e685-4b5e-aa2a-dc04f218e29c service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.139025 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-d608a5fa-9e79-42c2-bd72-e9f9cb259f22 req-9e1a07ce-e685-4b5e-aa2a-dc04f218e29c service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.149862 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-d608a5fa-9e79-42c2-bd72-e9f9cb259f22 req-9e1a07ce-e685-4b5e-aa2a-dc04f218e29c service nova] Creating event network-changed:58fa352a-6445-4306-b684-412b97a2e21a for instance 5f420c68-9a99-44d2-87e9-9761a71b6e99 on hv-cinder-76845 Nov 23 04:18:11.154553 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-d608a5fa-9e79-42c2-bd72-e9f9cb259f22 req-9e1a07ce-e685-4b5e-aa2a-dc04f218e29c service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029672 Nov 23 04:18:11.155120 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 372/675] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:11.170282 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4bac47c0-9b94-4b0b-93e3-2728f3c46b72 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:11.170886 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4bac47c0-9b94-4b0b-93e3-2728f3c46b72 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:11.177051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bac47c0-9b94-4b0b-93e3-2728f3c46b72 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.177494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bac47c0-9b94-4b0b-93e3-2728f3c46b72 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.178269 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bac47c0-9b94-4b0b-93e3-2728f3c46b72 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.178698 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bac47c0-9b94-4b0b-93e3-2728f3c46b72 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.246940 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-21fd149b-d966-45d9-b461-71e15b0630c9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:11.247660 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-21fd149b-d966-45d9-b461-71e15b0630c9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:11.253819 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-21fd149b-d966-45d9-b461-71e15b0630c9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.254264 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-21fd149b-d966-45d9-b461-71e15b0630c9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.255038 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-21fd149b-d966-45d9-b461-71e15b0630c9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.255495 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-21fd149b-d966-45d9-b461-71e15b0630c9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.450967 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4bac47c0-9b94-4b0b-93e3-2728f3c46b72 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:11.458358 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4bac47c0-9b94-4b0b-93e3-2728f3c46b72 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1546 microversion: 2.1 time: 0.291687 Nov 23 04:18:11.458924 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 304/676] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:11 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1546 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:11.465016 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-dcf46c8b-0e2a-4f37-badb-782470e7a459 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:11.465761 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-dcf46c8b-0e2a-4f37-badb-782470e7a459 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 1b618a52-9e4c-43d1-8b3d-97412bd51aed] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:11.471921 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dcf46c8b-0e2a-4f37-badb-782470e7a459 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.473554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dcf46c8b-0e2a-4f37-badb-782470e7a459 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.473554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dcf46c8b-0e2a-4f37-badb-782470e7a459 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.473869 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dcf46c8b-0e2a-4f37-badb-782470e7a459 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.488944 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-dcf46c8b-0e2a-4f37-badb-782470e7a459 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] HTTP exception thrown: Instance 1b618a52-9e4c-43d1-8b3d-97412bd51aed could not be found. Nov 23 04:18:11.489554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-dcf46c8b-0e2a-4f37-badb-782470e7a459 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Returning 404 to user: Instance 1b618a52-9e4c-43d1-8b3d-97412bd51aed could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:18:11.490400 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-dcf46c8b-0e2a-4f37-badb-782470e7a459 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed" status: 404 len: 111 microversion: 2.1 time: 0.030097 Nov 23 04:18:11.490995 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 305/677] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:11 2021] GET /compute/v2.1/servers/1b618a52-9e4c-43d1-8b3d-97412bd51aed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:18:11.497916 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8dd02ca1-a1c4-4e29-a268-b95044256fac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:11.498692 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8dd02ca1-a1c4-4e29-a268-b95044256fac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:11.504489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8dd02ca1-a1c4-4e29-a268-b95044256fac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.504961 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8dd02ca1-a1c4-4e29-a268-b95044256fac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.505751 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8dd02ca1-a1c4-4e29-a268-b95044256fac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.513706 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8dd02ca1-a1c4-4e29-a268-b95044256fac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.534244 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-21fd149b-d966-45d9-b461-71e15b0630c9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:11.543748 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-21fd149b-d966-45d9-b461-71e15b0630c9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:11.545341 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-21fd149b-d966-45d9-b461-71e15b0630c9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:11.548016 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-21fd149b-d966-45d9-b461-71e15b0630c9 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1791 microversion: 2.20 time: 0.303690 Nov 23 04:18:11.548016 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 373/678] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:11 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1791 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:18:11.553736 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d53f52ae-a9e7-4f6a-aea1-d5bbc32a5bf1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:11.553736 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d53f52ae-a9e7-4f6a-aea1-d5bbc32a5bf1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:11.558373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d53f52ae-a9e7-4f6a-aea1-d5bbc32a5bf1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.558816 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d53f52ae-a9e7-4f6a-aea1-d5bbc32a5bf1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.559733 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d53f52ae-a9e7-4f6a-aea1-d5bbc32a5bf1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.560167 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d53f52ae-a9e7-4f6a-aea1-d5bbc32a5bf1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.811413 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8dd02ca1-a1c4-4e29-a268-b95044256fac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:11.818812 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8dd02ca1-a1c4-4e29-a268-b95044256fac tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1314 microversion: 2.1 time: 0.326805 Nov 23 04:18:11.819426 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 306/679] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:11 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:11.831829 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d53f52ae-a9e7-4f6a-aea1-d5bbc32a5bf1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:11.840043 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d53f52ae-a9e7-4f6a-aea1-d5bbc32a5bf1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1546 microversion: 2.1 time: 0.291981 Nov 23 04:18:11.840698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 374/680] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:11 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1546 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:11.857791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5acb519c-54bc-4df2-a183-90a0622710e3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:11.861221 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:11.861221 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:18:11.862240 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5acb519c-54bc-4df2-a183-90a0622710e3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:11.862982 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5acb519c-54bc-4df2-a183-90a0622710e3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Searching by: {'deleted': False, 'project_id': '0dcc5d168617498bbafe5038567ca011'} {{(pid=116837) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 23 04:18:11.870243 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5acb519c-54bc-4df2-a183-90a0622710e3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.870686 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5acb519c-54bc-4df2-a183-90a0622710e3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.871505 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5acb519c-54bc-4df2-a183-90a0622710e3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.871937 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5acb519c-54bc-4df2-a183-90a0622710e3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.914638 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c1838f3a-3291-4f9a-a97c-946e39fdbff5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:11.915396 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c1838f3a-3291-4f9a-a97c-946e39fdbff5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:11.921288 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1838f3a-3291-4f9a-a97c-946e39fdbff5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.921809 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1838f3a-3291-4f9a-a97c-946e39fdbff5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.922733 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1838f3a-3291-4f9a-a97c-946e39fdbff5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:11.923247 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1838f3a-3291-4f9a-a97c-946e39fdbff5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:11.967067 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.multi_cell_list [None req-5acb519c-54bc-4df2-a183-90a0622710e3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116837) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 23 04:18:12.060676 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c1838f3a-3291-4f9a-a97c-946e39fdbff5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:12.063635 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5acb519c-54bc-4df2-a183-90a0622710e3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.209292 Nov 23 04:18:12.064216 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 307/681] 10.222.0.54 () {58 vars in 1124 bytes} [Tue Nov 23 04:18:11 2021] GET /compute/v2.1/servers => generated 341 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:12.068062 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c1838f3a-3291-4f9a-a97c-946e39fdbff5 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.158022 Nov 23 04:18:12.068623 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 375/682] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:11 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:12.074553 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-43739814-9bf5-4a00-a2ae-97ce7777b1e2 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:12.075154 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-43739814-9bf5-4a00-a2ae-97ce7777b1e2 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:12.081051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-43739814-9bf5-4a00-a2ae-97ce7777b1e2 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:12.083744 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-43739814-9bf5-4a00-a2ae-97ce7777b1e2 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:12.083744 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-43739814-9bf5-4a00-a2ae-97ce7777b1e2 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:12.083744 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-43739814-9bf5-4a00-a2ae-97ce7777b1e2 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:12.215004 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-43739814-9bf5-4a00-a2ae-97ce7777b1e2 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:12.222801 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-43739814-9bf5-4a00-a2ae-97ce7777b1e2 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1546 microversion: 2.1 time: 0.151958 Nov 23 04:18:12.223413 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 308/683] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:12 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:12.830168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bd4e3ef2-7915-4a08-91b0-54b1142e03fc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:12.830746 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bd4e3ef2-7915-4a08-91b0-54b1142e03fc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:12.835547 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-76772792-cb51-4fc4-a9e8-d777b2600a71 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:12.836155 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-76772792-cb51-4fc4-a9e8-d777b2600a71 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:12.837483 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bd4e3ef2-7915-4a08-91b0-54b1142e03fc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:12.837931 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bd4e3ef2-7915-4a08-91b0-54b1142e03fc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:12.838760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bd4e3ef2-7915-4a08-91b0-54b1142e03fc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:12.839200 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bd4e3ef2-7915-4a08-91b0-54b1142e03fc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:12.841918 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-76772792-cb51-4fc4-a9e8-d777b2600a71 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:12.842366 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-76772792-cb51-4fc4-a9e8-d777b2600a71 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:12.843141 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-76772792-cb51-4fc4-a9e8-d777b2600a71 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:12.843593 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-76772792-cb51-4fc4-a9e8-d777b2600a71 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:12.865641 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bd4e3ef2-7915-4a08-91b0-54b1142e03fc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:18:12.975892 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-76772792-cb51-4fc4-a9e8-d777b2600a71 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:12.982372 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-76772792-cb51-4fc4-a9e8-d777b2600a71 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1314 microversion: 2.1 time: 0.150482 Nov 23 04:18:12.983094 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 309/684] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:12 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:13.085719 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f6801ee6-7b0b-4661-ab30-693a336fad71 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:13.086437 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f6801ee6-7b0b-4661-ab30-693a336fad71 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:13.095050 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f6801ee6-7b0b-4661-ab30-693a336fad71 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:13.095731 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f6801ee6-7b0b-4661-ab30-693a336fad71 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:13.096421 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f6801ee6-7b0b-4661-ab30-693a336fad71 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:13.096713 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f6801ee6-7b0b-4661-ab30-693a336fad71 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:13.176898 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bd4e3ef2-7915-4a08-91b0-54b1142e03fc tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "DELETE /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 204 len: 0 microversion: 2.1 time: 0.349950 Nov 23 04:18:13.177513 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 376/685] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:18:12 2021] DELETE /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:18:13.186254 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2348466b-d494-47e9-9712-171e37989bff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:13.189352 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2348466b-d494-47e9-9712-171e37989bff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:13.192935 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2348466b-d494-47e9-9712-171e37989bff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:13.193446 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2348466b-d494-47e9-9712-171e37989bff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:13.194291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2348466b-d494-47e9-9712-171e37989bff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:13.194884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2348466b-d494-47e9-9712-171e37989bff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:13.248543 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f6801ee6-7b0b-4661-ab30-693a336fad71 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:13.256767 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f6801ee6-7b0b-4661-ab30-693a336fad71 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.174880 Nov 23 04:18:13.258629 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 310/686] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:13 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:13.338588 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2348466b-d494-47e9-9712-171e37989bff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:13.346479 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2348466b-d494-47e9-9712-171e37989bff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1514 microversion: 2.1 time: 0.164099 Nov 23 04:18:13.347577 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 377/687] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:13 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:14.000479 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-639da653-ca30-42cb-b1ec-6579332c2f5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:14.001088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-639da653-ca30-42cb-b1ec-6579332c2f5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:14.007000 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-639da653-ca30-42cb-b1ec-6579332c2f5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:14.007557 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-639da653-ca30-42cb-b1ec-6579332c2f5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:14.008357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-639da653-ca30-42cb-b1ec-6579332c2f5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:14.008798 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-639da653-ca30-42cb-b1ec-6579332c2f5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:14.164005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-639da653-ca30-42cb-b1ec-6579332c2f5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:14.172712 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-639da653-ca30-42cb-b1ec-6579332c2f5a tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1314 microversion: 2.1 time: 0.175756 Nov 23 04:18:14.173548 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 311/688] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:13 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:14.248619 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b6b887ef-49a7-473d-bf50-0ba353d838ac tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "023a514b-c26c-4af7-9de5-4007d6dc73d8"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:14.249733 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b6b887ef-49a7-473d-bf50-0ba353d838ac tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:14.256303 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b6b887ef-49a7-473d-bf50-0ba353d838ac tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:14.256662 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b6b887ef-49a7-473d-bf50-0ba353d838ac tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:14.258188 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b6b887ef-49a7-473d-bf50-0ba353d838ac tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:14.258618 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b6b887ef-49a7-473d-bf50-0ba353d838ac tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:14.274687 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1fb05ebc-dc96-462e-9302-3cb5fc805206 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:14.275327 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1fb05ebc-dc96-462e-9302-3cb5fc805206 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:14.281935 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1fb05ebc-dc96-462e-9302-3cb5fc805206 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:14.283068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1fb05ebc-dc96-462e-9302-3cb5fc805206 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:14.283948 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1fb05ebc-dc96-462e-9302-3cb5fc805206 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:14.284387 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1fb05ebc-dc96-462e-9302-3cb5fc805206 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:14.421723 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1fb05ebc-dc96-462e-9302-3cb5fc805206 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:14.429817 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1fb05ebc-dc96-462e-9302-3cb5fc805206 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.159210 Nov 23 04:18:14.430622 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 312/689] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:14 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:14.434871 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a4c3f596-55d6-41bf-ac67-6439bd312999 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:14.435494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a4c3f596-55d6-41bf-ac67-6439bd312999 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:14.441099 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4c3f596-55d6-41bf-ac67-6439bd312999 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:14.441544 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4c3f596-55d6-41bf-ac67-6439bd312999 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:14.442304 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4c3f596-55d6-41bf-ac67-6439bd312999 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:14.442761 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4c3f596-55d6-41bf-ac67-6439bd312999 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:14.577793 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a4c3f596-55d6-41bf-ac67-6439bd312999 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:14.585199 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a4c3f596-55d6-41bf-ac67-6439bd312999 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1514 microversion: 2.1 time: 0.153565 Nov 23 04:18:14.585890 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 313/690] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:14 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:15.135106 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b6b887ef-49a7-473d-bf50-0ba353d838ac tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "POST /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.890011 Nov 23 04:18:15.136016 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 378/691] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:18:14 2021] POST /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments => generated 194 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:15.189676 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7f1c9169-53fc-4d27-8df6-50de7399d279 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:15.190312 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7f1c9169-53fc-4d27-8df6-50de7399d279 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:15.196135 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7f1c9169-53fc-4d27-8df6-50de7399d279 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:15.196573 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7f1c9169-53fc-4d27-8df6-50de7399d279 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:15.197429 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7f1c9169-53fc-4d27-8df6-50de7399d279 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:15.197854 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7f1c9169-53fc-4d27-8df6-50de7399d279 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:15.330297 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7f1c9169-53fc-4d27-8df6-50de7399d279 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:15.338749 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7f1c9169-53fc-4d27-8df6-50de7399d279 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1314 microversion: 2.1 time: 0.152839 Nov 23 04:18:15.339440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 314/692] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:15 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:15.448339 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-35ca4eeb-77e7-43d5-a5ba-64f2964995cf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:15.449171 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-35ca4eeb-77e7-43d5-a5ba-64f2964995cf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:15.457583 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-35ca4eeb-77e7-43d5-a5ba-64f2964995cf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:15.458248 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-35ca4eeb-77e7-43d5-a5ba-64f2964995cf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:15.459256 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-35ca4eeb-77e7-43d5-a5ba-64f2964995cf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:15.459851 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-35ca4eeb-77e7-43d5-a5ba-64f2964995cf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:15.520887 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-b27d018f-3c1d-4820-8f12-59500e483821 req-5672f9c0-88fb-4e07-af37-f198d1ffae44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f420c68-9a99-44d2-87e9-9761a71b6e99", "name": "network-vif-plugged", "status": "completed", "tag": "58fa352a-6445-4306-b684-412b97a2e21a"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:15.522485 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:15.522485 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:18:15.530694 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-b27d018f-3c1d-4820-8f12-59500e483821 req-5672f9c0-88fb-4e07-af37-f198d1ffae44 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:15.531199 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-b27d018f-3c1d-4820-8f12-59500e483821 req-5672f9c0-88fb-4e07-af37-f198d1ffae44 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:15.542478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-b27d018f-3c1d-4820-8f12-59500e483821 req-5672f9c0-88fb-4e07-af37-f198d1ffae44 service nova] Creating event network-vif-plugged:58fa352a-6445-4306-b684-412b97a2e21a for instance 5f420c68-9a99-44d2-87e9-9761a71b6e99 on hv-cinder-76845 Nov 23 04:18:15.547747 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-b27d018f-3c1d-4820-8f12-59500e483821 req-5672f9c0-88fb-4e07-af37-f198d1ffae44 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030488 Nov 23 04:18:15.548708 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 315/693] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:18:15.604678 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-edbf2d51-02b4-4645-a644-a2d82de7dbd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:15.605303 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-edbf2d51-02b4-4645-a644-a2d82de7dbd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:15.611670 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edbf2d51-02b4-4645-a644-a2d82de7dbd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:15.612117 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edbf2d51-02b4-4645-a644-a2d82de7dbd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:15.612975 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edbf2d51-02b4-4645-a644-a2d82de7dbd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:15.613412 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edbf2d51-02b4-4645-a644-a2d82de7dbd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:15.717220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-35ca4eeb-77e7-43d5-a5ba-64f2964995cf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:15.746099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-35ca4eeb-77e7-43d5-a5ba-64f2964995cf tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.282168 Nov 23 04:18:15.746099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 379/694] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:15 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:15.862081 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-edbf2d51-02b4-4645-a644-a2d82de7dbd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:15.870626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-edbf2d51-02b4-4645-a644-a2d82de7dbd2 tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1514 microversion: 2.1 time: 0.270353 Nov 23 04:18:15.871317 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 316/695] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:15 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:16.128171 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-09d238be-2813-4ab3-a470-c5627dfc2696 req-16a943c3-11f2-4edc-947e-761b06ba9a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87273409-979f-4dd3-b901-60f00ba87d4c", "name": "network-vif-deleted", "tag": "832e3d40-1fef-4a95-9553-b2e7c02d57af"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:16.130147 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:16.130147 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:18:16.139707 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-09d238be-2813-4ab3-a470-c5627dfc2696 req-16a943c3-11f2-4edc-947e-761b06ba9a53 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:16.140146 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-09d238be-2813-4ab3-a470-c5627dfc2696 req-16a943c3-11f2-4edc-947e-761b06ba9a53 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:16.151246 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-09d238be-2813-4ab3-a470-c5627dfc2696 req-16a943c3-11f2-4edc-947e-761b06ba9a53 service nova] Creating event network-vif-deleted:832e3d40-1fef-4a95-9553-b2e7c02d57af for instance 87273409-979f-4dd3-b901-60f00ba87d4c on hv-cinder-76845 Nov 23 04:18:16.156389 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-09d238be-2813-4ab3-a470-c5627dfc2696 req-16a943c3-11f2-4edc-947e-761b06ba9a53 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032719 Nov 23 04:18:16.157171 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 380/696] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:18:16.356251 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-69c469c7-041b-4420-86ff-4a70ee8c2bb1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:16.356829 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-69c469c7-041b-4420-86ff-4a70ee8c2bb1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:16.363072 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-69c469c7-041b-4420-86ff-4a70ee8c2bb1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:16.363558 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-69c469c7-041b-4420-86ff-4a70ee8c2bb1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:16.364323 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-69c469c7-041b-4420-86ff-4a70ee8c2bb1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:16.364751 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-69c469c7-041b-4420-86ff-4a70ee8c2bb1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:16.494100 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-69c469c7-041b-4420-86ff-4a70ee8c2bb1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:16.501217 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-69c469c7-041b-4420-86ff-4a70ee8c2bb1 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1314 microversion: 2.1 time: 0.148775 Nov 23 04:18:16.501767 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 317/697] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:16 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:16.742870 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a598abd5-7a49-4860-a151-2281368754fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:16.743857 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a598abd5-7a49-4860-a151-2281368754fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:16.750343 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a598abd5-7a49-4860-a151-2281368754fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:16.750792 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a598abd5-7a49-4860-a151-2281368754fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:16.751781 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a598abd5-7a49-4860-a151-2281368754fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:16.752222 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a598abd5-7a49-4860-a151-2281368754fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:16.887915 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:16.891235 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:16.895080 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:16.895679 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:16.896476 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:16.896904 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:16.901125 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a598abd5-7a49-4860-a151-2281368754fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:16.908817 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a598abd5-7a49-4860-a151-2281368754fd tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.170518 Nov 23 04:18:16.909388 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 381/698] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:16 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:16.933397 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:16.933766 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:16.934211 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lazy-loading 'fault' on Instance uuid 87273409-979f-4dd3-b901-60f00ba87d4c {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:18:16.973514 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882a63823deb40dcb93ddc76f81ab9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc51e914f5e74ceca4086caa5a05b8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:16.981332 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-98d0598f-c4c0-405b-9cca-7d49dfd620ff tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 200 len: 1308 microversion: 2.1 time: 0.097020 Nov 23 04:18:16.981905 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 318/699] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:16 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:17.520760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9e8f0790-8646-44d1-96e0-8ee2c60c13c6 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:17.521282 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9e8f0790-8646-44d1-96e0-8ee2c60c13c6 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:17.527776 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9e8f0790-8646-44d1-96e0-8ee2c60c13c6 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:17.528219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9e8f0790-8646-44d1-96e0-8ee2c60c13c6 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:17.529007 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9e8f0790-8646-44d1-96e0-8ee2c60c13c6 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:17.529440 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9e8f0790-8646-44d1-96e0-8ee2c60c13c6 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:17.666445 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9e8f0790-8646-44d1-96e0-8ee2c60c13c6 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:17.674492 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9e8f0790-8646-44d1-96e0-8ee2c60c13c6 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1314 microversion: 2.1 time: 0.158310 Nov 23 04:18:17.675236 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 382/700] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:17 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:17.926934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4969da75-114d-4c8e-a4a6-92f65cec7d44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:17.927514 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4969da75-114d-4c8e-a4a6-92f65cec7d44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:17.933486 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4969da75-114d-4c8e-a4a6-92f65cec7d44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:17.933929 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4969da75-114d-4c8e-a4a6-92f65cec7d44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:17.934693 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4969da75-114d-4c8e-a4a6-92f65cec7d44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:17.935117 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4969da75-114d-4c8e-a4a6-92f65cec7d44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:17.998430 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fe05320d-ec32-416c-ab3b-31f8ea98cb6e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:17.999030 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fe05320d-ec32-416c-ab3b-31f8ea98cb6e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] [instance: 87273409-979f-4dd3-b901-60f00ba87d4c] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:18.005857 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fe05320d-ec32-416c-ab3b-31f8ea98cb6e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:18.006399 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fe05320d-ec32-416c-ab3b-31f8ea98cb6e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:18.007400 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fe05320d-ec32-416c-ab3b-31f8ea98cb6e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:18.008036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fe05320d-ec32-416c-ab3b-31f8ea98cb6e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:18.022271 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-fe05320d-ec32-416c-ab3b-31f8ea98cb6e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] HTTP exception thrown: Instance 87273409-979f-4dd3-b901-60f00ba87d4c could not be found. Nov 23 04:18:18.023463 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fe05320d-ec32-416c-ab3b-31f8ea98cb6e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] Returning 404 to user: Instance 87273409-979f-4dd3-b901-60f00ba87d4c could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:18:18.024283 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fe05320d-ec32-416c-ab3b-31f8ea98cb6e tempest-AttachVolumeNegativeTest-491441339 tempest-AttachVolumeNegativeTest-491441339-project] 10.222.0.54 "GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c" status: 404 len: 111 microversion: 2.1 time: 0.029576 Nov 23 04:18:18.025038 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 383/701] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:17 2021] GET /compute/v2.1/servers/87273409-979f-4dd3-b901-60f00ba87d4c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 04:18:18.148468 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4969da75-114d-4c8e-a4a6-92f65cec7d44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:18.155773 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4969da75-114d-4c8e-a4a6-92f65cec7d44 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1520 microversion: 2.1 time: 0.232465 Nov 23 04:18:18.156357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 319/702] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:17 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:18.690347 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-acddccb3-169e-4b8c-a32e-ab46fb9fb091 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:18.691019 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-acddccb3-169e-4b8c-a32e-ab46fb9fb091 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:18.698527 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acddccb3-169e-4b8c-a32e-ab46fb9fb091 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:18.698969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acddccb3-169e-4b8c-a32e-ab46fb9fb091 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:18.699774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acddccb3-169e-4b8c-a32e-ab46fb9fb091 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:18.700205 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acddccb3-169e-4b8c-a32e-ab46fb9fb091 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:19.003618 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-acddccb3-169e-4b8c-a32e-ab46fb9fb091 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:19.012983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-acddccb3-169e-4b8c-a32e-ab46fb9fb091 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1499 microversion: 2.1 time: 0.326181 Nov 23 04:18:19.013884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 384/703] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:18 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1499 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:19.027451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-7dc331d6-207b-4307-a74f-8ea0dcb1312d req-267a6a82-04cc-49ca-8a2c-105306f0212b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696e3da2-6fdb-4741-8f4f-fffccaf8d403", "name": "network-vif-deleted", "tag": "f48f6a3d-794b-4b20-922c-ac55129a50c5"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:19.029041 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:19.029041 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:18:19.036126 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-7dc331d6-207b-4307-a74f-8ea0dcb1312d req-267a6a82-04cc-49ca-8a2c-105306f0212b service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:19.036569 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-7dc331d6-207b-4307-a74f-8ea0dcb1312d req-267a6a82-04cc-49ca-8a2c-105306f0212b service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:19.048318 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-7dc331d6-207b-4307-a74f-8ea0dcb1312d req-267a6a82-04cc-49ca-8a2c-105306f0212b service nova] Creating event network-vif-deleted:f48f6a3d-794b-4b20-922c-ac55129a50c5 for instance 696e3da2-6fdb-4741-8f4f-fffccaf8d403 on hv-cinder-76845 Nov 23 04:18:19.053183 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-7dc331d6-207b-4307-a74f-8ea0dcb1312d req-267a6a82-04cc-49ca-8a2c-105306f0212b service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029998 Nov 23 04:18:19.054314 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 320/704] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:19.173158 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-322250d3-f316-4a2b-99f3-79128f3f98a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:19.177555 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-322250d3-f316-4a2b-99f3-79128f3f98a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:19.188398 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-322250d3-f316-4a2b-99f3-79128f3f98a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:19.189153 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-322250d3-f316-4a2b-99f3-79128f3f98a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:19.190095 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-322250d3-f316-4a2b-99f3-79128f3f98a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:19.190673 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-322250d3-f316-4a2b-99f3-79128f3f98a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:19.258983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-322250d3-f316-4a2b-99f3-79128f3f98a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9477961ce0bc4164be46f0a54a309d7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79d1a358755a4113b0a35cf50d3cc95a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:19.266169 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-322250d3-f316-4a2b-99f3-79128f3f98a0 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 200 len: 1306 microversion: 2.1 time: 0.096829 Nov 23 04:18:19.266932 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 385/705] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:19 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:20.080821 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0262036d-1770-4077-80a4-cddb66164139 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:20.081395 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0262036d-1770-4077-80a4-cddb66164139 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:20.087730 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0262036d-1770-4077-80a4-cddb66164139 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:20.088317 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0262036d-1770-4077-80a4-cddb66164139 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:20.089094 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0262036d-1770-4077-80a4-cddb66164139 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:20.089527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0262036d-1770-4077-80a4-cddb66164139 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:20.114963 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0262036d-1770-4077-80a4-cddb66164139 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Going to try to terminate instance {{(pid=116837) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:18:20.283640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2737427b-39b5-4c09-82ac-a98fc7ee4e99 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:20.284344 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2737427b-39b5-4c09-82ac-a98fc7ee4e99 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] [instance: 696e3da2-6fdb-4741-8f4f-fffccaf8d403] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:20.291195 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2737427b-39b5-4c09-82ac-a98fc7ee4e99 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:20.291697 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2737427b-39b5-4c09-82ac-a98fc7ee4e99 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:20.292570 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2737427b-39b5-4c09-82ac-a98fc7ee4e99 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:20.293034 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2737427b-39b5-4c09-82ac-a98fc7ee4e99 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:20.307197 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-2737427b-39b5-4c09-82ac-a98fc7ee4e99 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] HTTP exception thrown: Instance 696e3da2-6fdb-4741-8f4f-fffccaf8d403 could not be found. Nov 23 04:18:20.307809 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2737427b-39b5-4c09-82ac-a98fc7ee4e99 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] Returning 404 to user: Instance 696e3da2-6fdb-4741-8f4f-fffccaf8d403 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:18:20.308619 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2737427b-39b5-4c09-82ac-a98fc7ee4e99 tempest-ServerRescueNegativeTestJSON-940095381 tempest-ServerRescueNegativeTestJSON-940095381-project] 10.222.0.54 "GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403" status: 404 len: 111 microversion: 2.1 time: 0.028730 Nov 23 04:18:20.309152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 386/706] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:20 2021] GET /compute/v2.1/servers/696e3da2-6fdb-4741-8f4f-fffccaf8d403 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 23 04:18:20.528449 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0262036d-1770-4077-80a4-cddb66164139 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "DELETE /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 204 len: 0 microversion: 2.1 time: 0.451114 Nov 23 04:18:20.529257 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 321/707] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:18:20 2021] DELETE /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:18:20.539870 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-17e7cf06-75e7-482b-9804-79aaa3f5f64b tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:20.541010 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-17e7cf06-75e7-482b-9804-79aaa3f5f64b tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:20.547198 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-17e7cf06-75e7-482b-9804-79aaa3f5f64b tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:20.547416 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-17e7cf06-75e7-482b-9804-79aaa3f5f64b tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:20.549047 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-17e7cf06-75e7-482b-9804-79aaa3f5f64b tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:20.549659 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-17e7cf06-75e7-482b-9804-79aaa3f5f64b tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:20.787047 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-17e7cf06-75e7-482b-9804-79aaa3f5f64b tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:20.794816 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-17e7cf06-75e7-482b-9804-79aaa3f5f64b tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1505 microversion: 2.1 time: 0.259664 Nov 23 04:18:20.795408 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 387/708] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:20 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:21.812530 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b68610e3-d176-49fa-8461-240b44943b64 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:21.813227 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b68610e3-d176-49fa-8461-240b44943b64 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:21.820099 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b68610e3-d176-49fa-8461-240b44943b64 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:21.820612 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b68610e3-d176-49fa-8461-240b44943b64 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:21.821384 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b68610e3-d176-49fa-8461-240b44943b64 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:21.821821 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b68610e3-d176-49fa-8461-240b44943b64 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:22.090657 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-b68610e3-d176-49fa-8461-240b44943b64 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:22.098492 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b68610e3-d176-49fa-8461-240b44943b64 tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1505 microversion: 2.1 time: 0.289867 Nov 23 04:18:22.099418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 322/709] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:21 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:22.949737 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a0d35e38-d07d-4bf8-8dd4-3b4728bead3c tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7dd9803a0>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:22.979198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-611e815c-cc44-4bd5-9870-c9c26082e8d6 req-dd0d7d5c-fe0e-4a20-b9c4-cee1687745a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f420c68-9a99-44d2-87e9-9761a71b6e99", "name": "network-vif-deleted", "tag": "58fa352a-6445-4306-b684-412b97a2e21a"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:22.980754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:22.980754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:18:22.995300 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-611e815c-cc44-4bd5-9870-c9c26082e8d6 req-dd0d7d5c-fe0e-4a20-b9c4-cee1687745a7 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:22.995742 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-611e815c-cc44-4bd5-9870-c9c26082e8d6 req-dd0d7d5c-fe0e-4a20-b9c4-cee1687745a7 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:23.008126 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-611e815c-cc44-4bd5-9870-c9c26082e8d6 req-dd0d7d5c-fe0e-4a20-b9c4-cee1687745a7 service nova] Creating event network-vif-deleted:58fa352a-6445-4306-b684-412b97a2e21a for instance 5f420c68-9a99-44d2-87e9-9761a71b6e99 on hv-cinder-76845 Nov 23 04:18:23.013152 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-611e815c-cc44-4bd5-9870-c9c26082e8d6 req-dd0d7d5c-fe0e-4a20-b9c4-cee1687745a7 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037738 Nov 23 04:18:23.014104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 323/710] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:18:23.020911 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a0d35e38-d07d-4bf8-8dd4-3b4728bead3c tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/023dc7ed-8e5e-4311-a292-863129849eed" status: 200 len: 350 microversion: 2.1 time: 0.076575 Nov 23 04:18:23.021607 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 388/711] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:18:22 2021] GET /compute/v2.1/os-volumes/023dc7ed-8e5e-4311-a292-863129849eed => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:23.118021 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-be9b7dcc-c319-4b51-a33b-f2557a113e3c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:23.119104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-be9b7dcc-c319-4b51-a33b-f2557a113e3c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:23.126143 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-be9b7dcc-c319-4b51-a33b-f2557a113e3c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:23.127098 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-be9b7dcc-c319-4b51-a33b-f2557a113e3c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:23.133970 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-be9b7dcc-c319-4b51-a33b-f2557a113e3c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:23.134686 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-be9b7dcc-c319-4b51-a33b-f2557a113e3c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:23.216348 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-be9b7dcc-c319-4b51-a33b-f2557a113e3c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b20ce08f5765442dbdf399983b8df856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78807cb7ca9445b38b7e896adc10ec2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:23.225216 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-be9b7dcc-c319-4b51-a33b-f2557a113e3c tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 200 len: 1463 microversion: 2.1 time: 0.112560 Nov 23 04:18:23.226556 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 324/712] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:23 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 1463 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:23.737218 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bb0f704f-2fa7-4ddc-948a-c63ad50de168 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:23.738141 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bb0f704f-2fa7-4ddc-948a-c63ad50de168 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:23.745170 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb0f704f-2fa7-4ddc-948a-c63ad50de168 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:23.746098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb0f704f-2fa7-4ddc-948a-c63ad50de168 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:23.747094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb0f704f-2fa7-4ddc-948a-c63ad50de168 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:23.747570 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bb0f704f-2fa7-4ddc-948a-c63ad50de168 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:24.012518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-bb0f704f-2fa7-4ddc-948a-c63ad50de168 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:24.024927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bb0f704f-2fa7-4ddc-948a-c63ad50de168 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1592 microversion: 2.1 time: 0.288296 Nov 23 04:18:24.024927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 389/713] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:23 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1592 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:24.246164 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2b1e3c6c-a838-40bb-87e3-c72d3fbefb5e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:24.246781 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2b1e3c6c-a838-40bb-87e3-c72d3fbefb5e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] [instance: 5f420c68-9a99-44d2-87e9-9761a71b6e99] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:24.255848 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2b1e3c6c-a838-40bb-87e3-c72d3fbefb5e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:24.256295 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2b1e3c6c-a838-40bb-87e3-c72d3fbefb5e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:24.257372 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2b1e3c6c-a838-40bb-87e3-c72d3fbefb5e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:24.257904 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2b1e3c6c-a838-40bb-87e3-c72d3fbefb5e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:24.271974 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-2b1e3c6c-a838-40bb-87e3-c72d3fbefb5e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] HTTP exception thrown: Instance 5f420c68-9a99-44d2-87e9-9761a71b6e99 could not be found. Nov 23 04:18:24.273055 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2b1e3c6c-a838-40bb-87e3-c72d3fbefb5e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] Returning 404 to user: Instance 5f420c68-9a99-44d2-87e9-9761a71b6e99 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:18:24.274058 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2b1e3c6c-a838-40bb-87e3-c72d3fbefb5e tempest-VolumesActionsTest-1805291064 tempest-VolumesActionsTest-1805291064-project] 10.222.0.54 "GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99" status: 404 len: 111 microversion: 2.1 time: 0.032756 Nov 23 04:18:24.275330 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 325/714] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:24 2021] GET /compute/v2.1/servers/5f420c68-9a99-44d2-87e9-9761a71b6e99 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:18:24.873419 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1a30d664-4ac8-40e1-bb76-d3a997bef075 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7de2c0280>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:24.937405 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1a30d664-4ac8-40e1-bb76-d3a997bef075 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/627e0d34-fd4e-4949-a91c-27bb30d290b5" status: 200 len: 350 microversion: 2.1 time: 0.066585 Nov 23 04:18:24.938173 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 390/715] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:18:24 2021] GET /compute/v2.1/os-volumes/627e0d34-fd4e-4949-a91c-27bb30d290b5 => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:27.127495 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-2b8934d4-6352-4758-be10-5bde95e8947e req-247a4fa0-26f9-4e40-b02f-39fc894e169e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f1f74c-599b-40e5-aed9-cf063b9c46ac", "tag": "5dc60928-ecbb-432d-abab-7e8074ff19f9"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:27.129724 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:27.129724 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:18:27.137728 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-2b8934d4-6352-4758-be10-5bde95e8947e req-247a4fa0-26f9-4e40-b02f-39fc894e169e service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:27.138181 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-2b8934d4-6352-4758-be10-5bde95e8947e req-247a4fa0-26f9-4e40-b02f-39fc894e169e service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:27.161416 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-2b8934d4-6352-4758-be10-5bde95e8947e req-247a4fa0-26f9-4e40-b02f-39fc894e169e service nova] Creating event network-changed:5dc60928-ecbb-432d-abab-7e8074ff19f9 for instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac on hv-cinder-76845 Nov 23 04:18:27.167695 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-2b8934d4-6352-4758-be10-5bde95e8947e req-247a4fa0-26f9-4e40-b02f-39fc894e169e service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044104 Nov 23 04:18:27.172932 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 326/716] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:30.033907 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2d3386a9-7bb2-42ea-a1c1-677d40a6c2a5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1771096911"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:30.034496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2d3386a9-7bb2-42ea-a1c1-677d40a6c2a5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:30.041210 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d3386a9-7bb2-42ea-a1c1-677d40a6c2a5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:30.041659 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d3386a9-7bb2-42ea-a1c1-677d40a6c2a5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:30.042457 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d3386a9-7bb2-42ea-a1c1-677d40a6c2a5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:30.042966 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d3386a9-7bb2-42ea-a1c1-677d40a6c2a5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:30.127012 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-99c87dbf-8846-4d6b-987e-f90fbae16842 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7ddea3ca0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:30.181571 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-99c87dbf-8846-4d6b-987e-f90fbae16842 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/fd489ca3-8bd9-4e60-923a-e12ac4260d12" status: 200 len: 351 microversion: 2.1 time: 0.058726 Nov 23 04:18:30.186470 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 327/717] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:18:30 2021] GET /compute/v2.1/os-volumes/fd489ca3-8bd9-4e60-923a-e12ac4260d12 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:18:30.188110 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.network.security_group_api [None req-2d3386a9-7bb2-42ea-a1c1-677d40a6c2a5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Adding security group 33fb836f-8629-4586-a9ba-f4b64fc1791c to port 5dc60928-ecbb-432d-abab-7e8074ff19f9 Nov 23 04:18:30.196189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-68e73304-48cd-4201-9e42-0863521788fd tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7dddeb280>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:30.304345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-68e73304-48cd-4201-9e42-0863521788fd tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.111148 Nov 23 04:18:30.305632 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 328/718] 10.222.0.54 () {58 vars in 1133 bytes} [Tue Nov 23 04:18:30 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:30.320038 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8b57d729-26cb-42e1-b620-b135bbe4a26b tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7dde923a0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:30.410933 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8b57d729-26cb-42e1-b620-b135bbe4a26b tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094575 Nov 23 04:18:30.411554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 329/719] 10.222.0.54 () {58 vars in 1148 bytes} [Tue Nov 23 04:18:30 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:18:30.424076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6fa8f848-2755-4115-9d62-47bf63217cfa tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7de111b80>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:30.512293 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6fa8f848-2755-4115-9d62-47bf63217cfa tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091855 Nov 23 04:18:30.513286 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 330/720] 10.222.0.54 () {58 vars in 1133 bytes} [Tue Nov 23 04:18:30 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:30.525707 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bb5661a1-7d6f-4f94-8098-c5525bcfc241 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7ddf8a0d0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:30.609284 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bb5661a1-7d6f-4f94-8098-c5525bcfc241 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088995 Nov 23 04:18:30.609862 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 331/721] 10.222.0.54 () {58 vars in 1166 bytes} [Tue Nov 23 04:18:30 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:30.621233 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5fab576b-1474-45ba-8142-6cde1e4639c3 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7ddea3160>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:30.675350 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2d3386a9-7bb2-42ea-a1c1-677d40a6c2a5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "POST /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/action" status: 202 len: 0 microversion: 2.1 time: 0.645586 Nov 23 04:18:30.675973 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 391/722] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:18:30 2021] POST /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:18:30.696580 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b787434b-db13-44f6-bde0-f647797544c5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:30.697214 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b787434b-db13-44f6-bde0-f647797544c5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:30.718428 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b787434b-db13-44f6-bde0-f647797544c5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:30.721194 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b787434b-db13-44f6-bde0-f647797544c5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:30.722038 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b787434b-db13-44f6-bde0-f647797544c5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:30.722481 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b787434b-db13-44f6-bde0-f647797544c5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:30.816835 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5fab576b-1474-45ba-8142-6cde1e4639c3 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.198921 Nov 23 04:18:30.817401 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 332/723] 10.222.0.54 () {58 vars in 1169 bytes} [Tue Nov 23 04:18:30 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:18:30.824763 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-ed8ebf6b-d21c-431d-a1c9-148a1a3a8027 req-c023482c-373c-4ee3-97e8-9acee575b3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f1f74c-599b-40e5-aed9-cf063b9c46ac", "tag": "5dc60928-ecbb-432d-abab-7e8074ff19f9"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:30.824763 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:30.824763 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:18:30.842028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-ed8ebf6b-d21c-431d-a1c9-148a1a3a8027 req-c023482c-373c-4ee3-97e8-9acee575b3f6 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:30.842566 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-ed8ebf6b-d21c-431d-a1c9-148a1a3a8027 req-c023482c-373c-4ee3-97e8-9acee575b3f6 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:30.855943 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-ed8ebf6b-d21c-431d-a1c9-148a1a3a8027 req-c023482c-373c-4ee3-97e8-9acee575b3f6 service nova] Creating event network-changed:5dc60928-ecbb-432d-abab-7e8074ff19f9 for instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac on hv-cinder-76845 Nov 23 04:18:30.861255 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-ed8ebf6b-d21c-431d-a1c9-148a1a3a8027 req-c023482c-373c-4ee3-97e8-9acee575b3f6 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042693 Nov 23 04:18:30.861967 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 333/724] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:18:30.867916 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ad1c516b-a936-4062-97a6-d665808c5f40 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7dddeb670>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:31.006033 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ad1c516b-a936-4062-97a6-d665808c5f40 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.142664 Nov 23 04:18:31.006885 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 334/725] 10.222.0.54 () {58 vars in 1154 bytes} [Tue Nov 23 04:18:30 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:31.018358 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c53e6538-6945-4d3b-b424-e1932a641d28 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7ddf8af70>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:31.055004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b787434b-db13-44f6-bde0-f647797544c5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:31.065511 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b787434b-db13-44f6-bde0-f647797544c5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1758 microversion: 2.1 time: 0.379740 Nov 23 04:18:31.066480 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 392/726] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:30 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1758 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:31.160542 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c53e6538-6945-4d3b-b424-e1932a641d28 tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.146146 Nov 23 04:18:31.162271 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 335/727] 10.222.0.54 () {58 vars in 1187 bytes} [Tue Nov 23 04:18:31 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:18:31.175502 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d7e5d8e5-2b6d-4b9c-9c73-c0842e7d5f2d tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] Calling method '.version_select at 0x7fa7dd8143a0>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:31.463315 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d7e5d8e5-2b6d-4b9c-9c73-c0842e7d5f2d tempest-VolumesTestJSON-1714552756 tempest-VolumesTestJSON-1714552756-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.291124 Nov 23 04:18:31.463937 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 393/728] 10.222.0.54 () {58 vars in 1154 bytes} [Tue Nov 23 04:18:31 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:53.395360 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0f5c4886-58b8-4307-9ab1-ccca3158c50e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:53.395973 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0f5c4886-58b8-4307-9ab1-ccca3158c50e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:53.402278 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f5c4886-58b8-4307-9ab1-ccca3158c50e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:53.402730 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f5c4886-58b8-4307-9ab1-ccca3158c50e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:53.403593 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f5c4886-58b8-4307-9ab1-ccca3158c50e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:53.404016 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0f5c4886-58b8-4307-9ab1-ccca3158c50e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:53.436658 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0f5c4886-58b8-4307-9ab1-ccca3158c50e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments/3c3f8116-d706-4a0d-b06d-ba141d1660fe" status: 200 len: 194 microversion: 2.20 time: 0.045611 Nov 23 04:18:53.437273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 336/729] 10.222.0.54 () {60 vars in 1453 bytes} [Tue Nov 23 04:18:53 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments/3c3f8116-d706-4a0d-b06d-ba141d1660fe => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:18:53.588959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b666f7f5-6d2f-45ca-8d97-cfe5c095bcac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:53.593269 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b666f7f5-6d2f-45ca-8d97-cfe5c095bcac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:53.596261 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b666f7f5-6d2f-45ca-8d97-cfe5c095bcac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:53.596921 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b666f7f5-6d2f-45ca-8d97-cfe5c095bcac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:53.597699 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b666f7f5-6d2f-45ca-8d97-cfe5c095bcac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:53.598137 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b666f7f5-6d2f-45ca-8d97-cfe5c095bcac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:53.624317 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-859ea260-6902-4076-9e91-2d03441f86ed tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:53.625355 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-859ea260-6902-4076-9e91-2d03441f86ed tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:53.633553 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-859ea260-6902-4076-9e91-2d03441f86ed tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:53.640902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-859ea260-6902-4076-9e91-2d03441f86ed tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:53.640902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-859ea260-6902-4076-9e91-2d03441f86ed tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:53.640902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-859ea260-6902-4076-9e91-2d03441f86ed tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:53.714765 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-b666f7f5-6d2f-45ca-8d97-cfe5c095bcac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lazy-loading 'services' on Instance uuid 8c13d4db-587d-4d4e-b8cc-23632d768572 {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:18:53.909740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-859ea260-6902-4076-9e91-2d03441f86ed tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "POST /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/action" status: 202 len: 0 microversion: 2.1 time: 0.291795 Nov 23 04:18:53.910584 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 337/730] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:18:53 2021] POST /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:18:53.923829 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-51724df4-6e40-419b-b9fe-adc7ec89940d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:53.924527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-51724df4-6e40-419b-b9fe-adc7ec89940d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:53.930513 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-51724df4-6e40-419b-b9fe-adc7ec89940d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:53.930958 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-51724df4-6e40-419b-b9fe-adc7ec89940d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:53.931756 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-51724df4-6e40-419b-b9fe-adc7ec89940d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:53.932187 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-51724df4-6e40-419b-b9fe-adc7ec89940d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:53.961642 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b666f7f5-6d2f-45ca-8d97-cfe5c095bcac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "DELETE /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments/3c3f8116-d706-4a0d-b06d-ba141d1660fe" status: 202 len: 0 microversion: 2.20 time: 0.376472 Nov 23 04:18:53.962601 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 394/731] 10.222.0.54 () {60 vars in 1456 bytes} [Tue Nov 23 04:18:53 2021] DELETE /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments/3c3f8116-d706-4a0d-b06d-ba141d1660fe => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:18:53.972563 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e9c5b6cd-20e7-4289-99d3-68f6bf475dac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:53.973196 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e9c5b6cd-20e7-4289-99d3-68f6bf475dac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:53.980459 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e9c5b6cd-20e7-4289-99d3-68f6bf475dac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:53.980988 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e9c5b6cd-20e7-4289-99d3-68f6bf475dac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:53.981844 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e9c5b6cd-20e7-4289-99d3-68f6bf475dac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:53.982338 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e9c5b6cd-20e7-4289-99d3-68f6bf475dac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:54.018526 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e9c5b6cd-20e7-4289-99d3-68f6bf475dac tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050553 Nov 23 04:18:54.023154 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 395/732] 10.222.0.54 () {60 vars in 1342 bytes} [Tue Nov 23 04:18:53 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:18:54.109554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-51724df4-6e40-419b-b9fe-adc7ec89940d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:54.118513 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-51724df4-6e40-419b-b9fe-adc7ec89940d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1750 microversion: 2.1 time: 0.198340 Nov 23 04:18:54.119097 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 338/733] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:53 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1750 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:18:55.030698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8cd0d42f-6a95-40e2-8a28-a8d7af4f1317 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:55.031845 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8cd0d42f-6a95-40e2-8a28-a8d7af4f1317 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:55.038902 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8cd0d42f-6a95-40e2-8a28-a8d7af4f1317 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:55.039477 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8cd0d42f-6a95-40e2-8a28-a8d7af4f1317 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:55.040259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8cd0d42f-6a95-40e2-8a28-a8d7af4f1317 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:55.040690 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8cd0d42f-6a95-40e2-8a28-a8d7af4f1317 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:55.069644 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8cd0d42f-6a95-40e2-8a28-a8d7af4f1317 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042692 Nov 23 04:18:55.070201 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 396/734] 10.222.0.54 () {60 vars in 1342 bytes} [Tue Nov 23 04:18:55 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:18:55.137251 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-58fddfcb-6b8f-4dcf-ad1a-5ff1b12f5eb1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:55.137871 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-58fddfcb-6b8f-4dcf-ad1a-5ff1b12f5eb1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:55.144085 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-58fddfcb-6b8f-4dcf-ad1a-5ff1b12f5eb1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:55.144536 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-58fddfcb-6b8f-4dcf-ad1a-5ff1b12f5eb1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:55.145348 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-58fddfcb-6b8f-4dcf-ad1a-5ff1b12f5eb1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:55.145818 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-58fddfcb-6b8f-4dcf-ad1a-5ff1b12f5eb1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:55.305581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-58fddfcb-6b8f-4dcf-ad1a-5ff1b12f5eb1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:55.313572 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-58fddfcb-6b8f-4dcf-ad1a-5ff1b12f5eb1 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1755 microversion: 2.1 time: 0.180774 Nov 23 04:18:55.314151 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 339/735] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:55 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:56.081536 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1a3eaef7-1a12-4e3c-87be-df95c00041eb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:56.082565 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1a3eaef7-1a12-4e3c-87be-df95c00041eb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:56.089873 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a3eaef7-1a12-4e3c-87be-df95c00041eb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:56.090583 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a3eaef7-1a12-4e3c-87be-df95c00041eb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:56.091417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a3eaef7-1a12-4e3c-87be-df95c00041eb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:56.091853 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a3eaef7-1a12-4e3c-87be-df95c00041eb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:56.121250 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1a3eaef7-1a12-4e3c-87be-df95c00041eb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043479 Nov 23 04:18:56.121574 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 397/736] 10.222.0.54 () {60 vars in 1342 bytes} [Tue Nov 23 04:18:56 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:56.190214 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-73d1aba5-08d9-4279-bbb4-f63d2ccad8d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:56.190757 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-73d1aba5-08d9-4279-bbb4-f63d2ccad8d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:56.197479 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-73d1aba5-08d9-4279-bbb4-f63d2ccad8d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:56.197929 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-73d1aba5-08d9-4279-bbb4-f63d2ccad8d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:56.198706 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-73d1aba5-08d9-4279-bbb4-f63d2ccad8d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:56.199144 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-73d1aba5-08d9-4279-bbb4-f63d2ccad8d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:56.223686 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-73d1aba5-08d9-4279-bbb4-f63d2ccad8d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Going to try to terminate instance {{(pid=116837) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:18:56.332089 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-db418891-0f60-484e-bb0a-f575c7c56032 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:56.332702 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-db418891-0f60-484e-bb0a-f575c7c56032 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:56.338765 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-db418891-0f60-484e-bb0a-f575c7c56032 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:56.341809 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-db418891-0f60-484e-bb0a-f575c7c56032 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:56.341809 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-db418891-0f60-484e-bb0a-f575c7c56032 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:56.341809 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-db418891-0f60-484e-bb0a-f575c7c56032 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:56.507860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-db418891-0f60-484e-bb0a-f575c7c56032 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:56.514861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-db418891-0f60-484e-bb0a-f575c7c56032 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1755 microversion: 2.1 time: 0.186332 Nov 23 04:18:56.515633 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 398/737] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:56 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:56.530934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-73d1aba5-08d9-4279-bbb4-f63d2ccad8d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "DELETE /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 204 len: 0 microversion: 2.20 time: 0.344023 Nov 23 04:18:56.531577 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 340/738] 10.222.0.54 () {60 vars in 1279 bytes} [Tue Nov 23 04:18:56 2021] DELETE /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 04:18:56.549420 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8ab94246-70b5-4d60-ae43-28aa1dde5892 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:56.550022 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8ab94246-70b5-4d60-ae43-28aa1dde5892 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:56.560090 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ab94246-70b5-4d60-ae43-28aa1dde5892 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:56.560768 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ab94246-70b5-4d60-ae43-28aa1dde5892 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:56.561924 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ab94246-70b5-4d60-ae43-28aa1dde5892 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:56.562359 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8ab94246-70b5-4d60-ae43-28aa1dde5892 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:56.723552 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8ab94246-70b5-4d60-ae43-28aa1dde5892 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:56.735982 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8ab94246-70b5-4d60-ae43-28aa1dde5892 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:56.738450 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8ab94246-70b5-4d60-ae43-28aa1dde5892 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:56.739944 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8ab94246-70b5-4d60-ae43-28aa1dde5892 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.194483 Nov 23 04:18:56.747565 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 399/739] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:56 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:18:57.532858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-edea44ea-e5fe-4454-8894-049e8bfe609b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:57.533582 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-edea44ea-e5fe-4454-8894-049e8bfe609b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:57.549797 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edea44ea-e5fe-4454-8894-049e8bfe609b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:57.549797 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edea44ea-e5fe-4454-8894-049e8bfe609b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:57.549797 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edea44ea-e5fe-4454-8894-049e8bfe609b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:57.549797 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-edea44ea-e5fe-4454-8894-049e8bfe609b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:57.720153 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-edea44ea-e5fe-4454-8894-049e8bfe609b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:57.728050 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-edea44ea-e5fe-4454-8894-049e8bfe609b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1755 microversion: 2.1 time: 0.199455 Nov 23 04:18:57.728623 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 341/740] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:57 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:57.758536 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-05a27713-044f-4b8f-995c-3d261a35313c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:57.759276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-05a27713-044f-4b8f-995c-3d261a35313c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:57.765799 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-05a27713-044f-4b8f-995c-3d261a35313c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:57.766314 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-05a27713-044f-4b8f-995c-3d261a35313c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:57.767203 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-05a27713-044f-4b8f-995c-3d261a35313c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:57.767734 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-05a27713-044f-4b8f-995c-3d261a35313c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:57.905711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-05a27713-044f-4b8f-995c-3d261a35313c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:57.913872 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-05a27713-044f-4b8f-995c-3d261a35313c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:57.915551 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-05a27713-044f-4b8f-995c-3d261a35313c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:57.916707 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-05a27713-044f-4b8f-995c-3d261a35313c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.162789 Nov 23 04:18:57.917273 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 400/741] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:57 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:18:58.745424 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f3333166-bb6a-4ab0-9dbf-eed4463d7a87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:58.746036 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f3333166-bb6a-4ab0-9dbf-eed4463d7a87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:58.752842 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f3333166-bb6a-4ab0-9dbf-eed4463d7a87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:58.753771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f3333166-bb6a-4ab0-9dbf-eed4463d7a87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:58.754322 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f3333166-bb6a-4ab0-9dbf-eed4463d7a87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:58.754759 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f3333166-bb6a-4ab0-9dbf-eed4463d7a87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:58.934829 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-aab207df-07fa-4816-83aa-cf014e17cd83 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:18:58.935504 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-aab207df-07fa-4816-83aa-cf014e17cd83 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:18:58.942040 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aab207df-07fa-4816-83aa-cf014e17cd83 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:58.942488 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aab207df-07fa-4816-83aa-cf014e17cd83 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:58.943995 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aab207df-07fa-4816-83aa-cf014e17cd83 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:58.944631 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aab207df-07fa-4816-83aa-cf014e17cd83 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:59.364817 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-aab207df-07fa-4816-83aa-cf014e17cd83 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:59.373156 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-aab207df-07fa-4816-83aa-cf014e17cd83 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:59.374741 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-aab207df-07fa-4816-83aa-cf014e17cd83 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:59.376243 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-aab207df-07fa-4816-83aa-cf014e17cd83 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1719 microversion: 2.20 time: 0.445061 Nov 23 04:18:59.376888 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 401/742] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:18:58 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1719 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:18:59.391176 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f3333166-bb6a-4ab0-9dbf-eed4463d7a87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:18:59.399648 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f3333166-bb6a-4ab0-9dbf-eed4463d7a87 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1755 microversion: 2.1 time: 0.657856 Nov 23 04:18:59.400325 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 342/743] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:18:58 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1755 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:18:59.840974 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-944c8e43-0c64-46de-9971-ebd9d01b16f2 req-b9efa588-aef4-401c-b4ea-621213507c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c13d4db-587d-4d4e-b8cc-23632d768572", "name": "network-vif-deleted", "tag": "1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:18:59.842554 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:18:59.842554 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:18:59.851528 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-944c8e43-0c64-46de-9971-ebd9d01b16f2 req-b9efa588-aef4-401c-b4ea-621213507c83 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:18:59.852008 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-944c8e43-0c64-46de-9971-ebd9d01b16f2 req-b9efa588-aef4-401c-b4ea-621213507c83 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:18:59.865926 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-944c8e43-0c64-46de-9971-ebd9d01b16f2 req-b9efa588-aef4-401c-b4ea-621213507c83 service nova] Creating event network-vif-deleted:1e9b19e9-43dd-4b57-b56d-cc03a86fbbc2 for instance 8c13d4db-587d-4d4e-b8cc-23632d768572 on hv-cinder-76845 Nov 23 04:18:59.871294 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-944c8e43-0c64-46de-9971-ebd9d01b16f2 req-b9efa588-aef4-401c-b4ea-621213507c83 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 Nov 23 04:18:59.871853 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 402/744] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:18:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:19:00.394927 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:00.396331 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:00.403999 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:00.404704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:00.405655 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:00.406249 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:00.420849 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2ce5c3b1-5f74-422d-afa6-23f179b7b334 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:00.422504 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2ce5c3b1-5f74-422d-afa6-23f179b7b334 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:00.435314 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2ce5c3b1-5f74-422d-afa6-23f179b7b334 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:00.436371 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2ce5c3b1-5f74-422d-afa6-23f179b7b334 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:00.437404 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2ce5c3b1-5f74-422d-afa6-23f179b7b334 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:00.438268 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2ce5c3b1-5f74-422d-afa6-23f179b7b334 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:00.442673 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:00.443329 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:00.443607 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lazy-loading 'fault' on Instance uuid 8c13d4db-587d-4d4e-b8cc-23632d768572 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:19:00.492032 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:00.513975 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:00.516084 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:00.517532 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a4f56eff-46d6-4c60-aca4-2a5d923e2f5b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 200 len: 1370 microversion: 2.20 time: 0.127347 Nov 23 04:19:00.527458 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 343/745] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:00 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 1370 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:00.694286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2ce5c3b1-5f74-422d-afa6-23f179b7b334 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:00.703646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2ce5c3b1-5f74-422d-afa6-23f179b7b334 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1755 microversion: 2.1 time: 0.289081 Nov 23 04:19:00.704515 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 403/746] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:00 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1755 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:01.540104 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-99d0849b-d505-4b8e-b413-7fc37d3a0a7c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:01.540746 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-99d0849b-d505-4b8e-b413-7fc37d3a0a7c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:01.547028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d0849b-d505-4b8e-b413-7fc37d3a0a7c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:01.547501 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d0849b-d505-4b8e-b413-7fc37d3a0a7c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:01.551489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d0849b-d505-4b8e-b413-7fc37d3a0a7c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:01.551489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d0849b-d505-4b8e-b413-7fc37d3a0a7c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:01.564153 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-99d0849b-d505-4b8e-b413-7fc37d3a0a7c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] HTTP exception thrown: Instance 8c13d4db-587d-4d4e-b8cc-23632d768572 could not be found. Nov 23 04:19:01.564659 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-99d0849b-d505-4b8e-b413-7fc37d3a0a7c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Returning 404 to user: Instance 8c13d4db-587d-4d4e-b8cc-23632d768572 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:19:01.565535 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-99d0849b-d505-4b8e-b413-7fc37d3a0a7c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 404 len: 111 microversion: 2.20 time: 0.030324 Nov 23 04:19:01.566103 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 344/747] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:01 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 04:19:01.576179 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-08fb4863-0ed9-47b7-be81-bf1970a34c33 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '.version_select at 0x7fa7dd9803a0>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:01.721840 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c94dc6df-e076-4725-baa0-42771359d787 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:01.722492 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c94dc6df-e076-4725-baa0-42771359d787 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:01.729540 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c94dc6df-e076-4725-baa0-42771359d787 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:01.730125 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c94dc6df-e076-4725-baa0-42771359d787 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:01.731026 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c94dc6df-e076-4725-baa0-42771359d787 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:01.731556 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c94dc6df-e076-4725-baa0-42771359d787 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:01.743452 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-08fb4863-0ed9-47b7-be81-bf1970a34c33 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-270007756" status: 204 len: 0 microversion: 2.20 time: 0.171851 Nov 23 04:19:01.747310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 404/748] 10.222.0.54 () {60 vars in 1258 bytes} [Tue Nov 23 04:19:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-270007756 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 04:19:02.011654 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c94dc6df-e076-4725-baa0-42771359d787 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:02.019894 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c94dc6df-e076-4725-baa0-42771359d787 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1755 microversion: 2.1 time: 0.301707 Nov 23 04:19:02.020469 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 345/749] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:01 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1755 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:19:02.741511 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-aa87d928-11b4-493b-ac9f-888d0dd2cd41 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'create', calling method: .version_select at 0x7fa7dd777310>, body: {"keypair": {"name": "tempest-keypair-1152023082"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:02.756864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-aa87d928-11b4-493b-ac9f-888d0dd2cd41 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:19:02.760473 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-aa87d928-11b4-493b-ac9f-888d0dd2cd41 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for user 1009c9c7798f48f6ad891766711d0c0f and project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:19:03.039660 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-932746aa-4f14-4e89-9680-cc2f9369c5de tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:03.040852 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-932746aa-4f14-4e89-9680-cc2f9369c5de tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:03.048537 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-932746aa-4f14-4e89-9680-cc2f9369c5de tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:03.049095 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-932746aa-4f14-4e89-9680-cc2f9369c5de tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:03.049950 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-932746aa-4f14-4e89-9680-cc2f9369c5de tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:03.050360 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-932746aa-4f14-4e89-9680-cc2f9369c5de tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:03.147543 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-aa87d928-11b4-493b-ac9f-888d0dd2cd41 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:19:03.151485 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-aa87d928-11b4-493b-ac9f-888d0dd2cd41 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for user 1009c9c7798f48f6ad891766711d0c0f and project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:19:03.167533 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-aa87d928-11b4-493b-ac9f-888d0dd2cd41 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.429816 Nov 23 04:19:03.168663 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 405/750] 10.222.0.54 () {62 vars in 1198 bytes} [Tue Nov 23 04:19:02 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 431 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 23 04:19:03.235706 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-932746aa-4f14-4e89-9680-cc2f9369c5de tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:03.244825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-932746aa-4f14-4e89-9680-cc2f9369c5de tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1755 microversion: 2.1 time: 0.210239 Nov 23 04:19:03.245618 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 346/751] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:03 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1755 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:19:04.262959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-09d0d464-aa45-4ab0-90b9-f93e9faa12bf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:04.264768 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-09d0d464-aa45-4ab0-90b9-f93e9faa12bf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:04.270901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-09d0d464-aa45-4ab0-90b9-f93e9faa12bf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:04.271118 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-09d0d464-aa45-4ab0-90b9-f93e9faa12bf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:04.272544 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-09d0d464-aa45-4ab0-90b9-f93e9faa12bf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:04.272981 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-09d0d464-aa45-4ab0-90b9-f93e9faa12bf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:04.431652 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-09d0d464-aa45-4ab0-90b9-f93e9faa12bf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:04.439444 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-09d0d464-aa45-4ab0-90b9-f93e9faa12bf tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1755 microversion: 2.1 time: 0.181021 Nov 23 04:19:04.440006 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 406/752] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:04 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:05.457659 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-29620746-8fa1-47d1-aea2-2fec45bc5e4d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:05.458516 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-29620746-8fa1-47d1-aea2-2fec45bc5e4d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:05.465545 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-29620746-8fa1-47d1-aea2-2fec45bc5e4d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:05.466046 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-29620746-8fa1-47d1-aea2-2fec45bc5e4d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:05.466868 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-29620746-8fa1-47d1-aea2-2fec45bc5e4d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:05.467559 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-29620746-8fa1-47d1-aea2-2fec45bc5e4d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:05.731332 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-29620746-8fa1-47d1-aea2-2fec45bc5e4d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:05.739255 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-29620746-8fa1-47d1-aea2-2fec45bc5e4d tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1755 microversion: 2.1 time: 0.285357 Nov 23 04:19:05.740570 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 347/753] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:05 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1755 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:06.058463 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1026491135", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fca30bf0-6b8e-488c-ba53-d9bc0d901c60"}], "security_groups": [{"name": "tempest-securitygroup--1390237783"}], "key_name": "tempest-keypair-1152023082", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:06.165074 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] validate_networks() for [('fca30bf0-6b8e-488c-ba53-d9bc0d901c60', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:19:06.551258 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:19:06.551746 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:19:06.552231 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:19:06.552636 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:19:06.553099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:19:06.561619 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:06.562063 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:06.563080 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:06.563569 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:06.581460 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:19:06.586042 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Getting quotas for user 1009c9c7798f48f6ad891766711d0c0f and project 891dccdfaeb440dd89a185b6d130b3f0. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:19:06.596427 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:19:06.598790 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:19:06.757380 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3522c1c9-c688-42ff-b5c4-3c3a0bbb42d3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:06.757986 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3522c1c9-c688-42ff-b5c4-3c3a0bbb42d3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:06.764125 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3522c1c9-c688-42ff-b5c4-3c3a0bbb42d3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:06.764565 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3522c1c9-c688-42ff-b5c4-3c3a0bbb42d3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:06.765327 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3522c1c9-c688-42ff-b5c4-3c3a0bbb42d3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:06.765753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3522c1c9-c688-42ff-b5c4-3c3a0bbb42d3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:06.787764 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7b16d452-3c0f-4d40-9514-598e872e7117 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.732842 Nov 23 04:19:06.788726 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 407/754] 10.222.0.54 () {62 vars in 1187 bytes} [Tue Nov 23 04:19:06 2021] POST /compute/v2.1/servers => generated 402 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 23 04:19:06.798354 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5b9aa0fb-e18a-4314-b000-21ad2c77734d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:06.799036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5b9aa0fb-e18a-4314-b000-21ad2c77734d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:06.882583 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5b9aa0fb-e18a-4314-b000-21ad2c77734d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:06.891332 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5b9aa0fb-e18a-4314-b000-21ad2c77734d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:06.893609 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5b9aa0fb-e18a-4314-b000-21ad2c77734d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:06.895022 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5b9aa0fb-e18a-4314-b000-21ad2c77734d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1282 microversion: 2.20 time: 0.100396 Nov 23 04:19:06.911002 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 408/755] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:06 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:19:06.995178 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3522c1c9-c688-42ff-b5c4-3c3a0bbb42d3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:07.003146 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3522c1c9-c688-42ff-b5c4-3c3a0bbb42d3 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1758 microversion: 2.1 time: 0.249926 Nov 23 04:19:07.003703 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 348/756] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:06 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1758 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:19:07.914740 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-87d079b8-5ff4-4136-807b-20a2506d5e23 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:07.915702 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-87d079b8-5ff4-4136-807b-20a2506d5e23 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:07.928889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-87d079b8-5ff4-4136-807b-20a2506d5e23 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:07.928889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-87d079b8-5ff4-4136-807b-20a2506d5e23 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:07.928889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-87d079b8-5ff4-4136-807b-20a2506d5e23 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:07.929614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-87d079b8-5ff4-4136-807b-20a2506d5e23 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:08.032508 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-87d079b8-5ff4-4136-807b-20a2506d5e23 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:08.041238 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-87d079b8-5ff4-4136-807b-20a2506d5e23 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:08.042707 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-87d079b8-5ff4-4136-807b-20a2506d5e23 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:08.043855 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-87d079b8-5ff4-4136-807b-20a2506d5e23 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1286 microversion: 2.20 time: 0.134109 Nov 23 04:19:08.044406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 409/757] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:07 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:09.065909 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2623d086-0713-4ad4-b3c1-7b590fa9a629 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:09.066570 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2623d086-0713-4ad4-b3c1-7b590fa9a629 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:09.078476 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2623d086-0713-4ad4-b3c1-7b590fa9a629 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:09.078921 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2623d086-0713-4ad4-b3c1-7b590fa9a629 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:09.088258 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2623d086-0713-4ad4-b3c1-7b590fa9a629 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:09.088923 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2623d086-0713-4ad4-b3c1-7b590fa9a629 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:09.170238 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2623d086-0713-4ad4-b3c1-7b590fa9a629 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:09.180916 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2623d086-0713-4ad4-b3c1-7b590fa9a629 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:09.182808 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2623d086-0713-4ad4-b3c1-7b590fa9a629 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:09.184142 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2623d086-0713-4ad4-b3c1-7b590fa9a629 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1334 microversion: 2.20 time: 0.122231 Nov 23 04:19:09.184708 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 349/758] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:09 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1334 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:10.201716 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a4073305-506b-49a6-9d87-2f2db32edf1d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:10.202338 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a4073305-506b-49a6-9d87-2f2db32edf1d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:10.208140 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4073305-506b-49a6-9d87-2f2db32edf1d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:10.209299 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4073305-506b-49a6-9d87-2f2db32edf1d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:10.210121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4073305-506b-49a6-9d87-2f2db32edf1d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:10.210550 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4073305-506b-49a6-9d87-2f2db32edf1d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:10.438688 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a4073305-506b-49a6-9d87-2f2db32edf1d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:10.448850 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a4073305-506b-49a6-9d87-2f2db32edf1d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:10.450917 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a4073305-506b-49a6-9d87-2f2db32edf1d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:10.452105 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a4073305-506b-49a6-9d87-2f2db32edf1d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1408 microversion: 2.20 time: 0.254201 Nov 23 04:19:10.452812 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 410/759] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:10 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:11.313980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-bbc8c3d4-c9f3-4df0-a6ed-e9906475679e req-95bfac13-8fb3-4275-9833-35d2dc6525f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2542af4-c4d5-4fc0-b86c-00df6da8fd61", "tag": "ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:11.316014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:19:11.316014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:19:11.323418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-bbc8c3d4-c9f3-4df0-a6ed-e9906475679e req-95bfac13-8fb3-4275-9833-35d2dc6525f7 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:11.324303 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-bbc8c3d4-c9f3-4df0-a6ed-e9906475679e req-95bfac13-8fb3-4275-9833-35d2dc6525f7 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:11.339614 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-bbc8c3d4-c9f3-4df0-a6ed-e9906475679e req-95bfac13-8fb3-4275-9833-35d2dc6525f7 service nova] Creating event network-changed:ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673 for instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 on hv-cinder-76845 Nov 23 04:19:11.345661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-bbc8c3d4-c9f3-4df0-a6ed-e9906475679e req-95bfac13-8fb3-4275-9833-35d2dc6525f7 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036425 Nov 23 04:19:11.346536 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 350/760] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:19:11.473826 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b7ba292c-39e7-4e91-9dda-03e0c52dcc20 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:11.475894 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b7ba292c-39e7-4e91-9dda-03e0c52dcc20 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:11.484762 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b7ba292c-39e7-4e91-9dda-03e0c52dcc20 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:11.487107 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b7ba292c-39e7-4e91-9dda-03e0c52dcc20 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:11.488662 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b7ba292c-39e7-4e91-9dda-03e0c52dcc20 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:11.490853 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b7ba292c-39e7-4e91-9dda-03e0c52dcc20 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:12.016946 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b7ba292c-39e7-4e91-9dda-03e0c52dcc20 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:12.025990 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b7ba292c-39e7-4e91-9dda-03e0c52dcc20 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:12.027519 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b7ba292c-39e7-4e91-9dda-03e0c52dcc20 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:12.028618 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b7ba292c-39e7-4e91-9dda-03e0c52dcc20 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1408 microversion: 2.20 time: 0.558730 Nov 23 04:19:12.029177 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 411/761] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:11 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1408 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:13.048781 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5660fd40-244c-4479-9216-243b9a8b07b5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:13.049463 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5660fd40-244c-4479-9216-243b9a8b07b5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:13.056613 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5660fd40-244c-4479-9216-243b9a8b07b5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:13.057056 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5660fd40-244c-4479-9216-243b9a8b07b5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:13.057825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5660fd40-244c-4479-9216-243b9a8b07b5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:13.058251 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5660fd40-244c-4479-9216-243b9a8b07b5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:13.191948 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5660fd40-244c-4479-9216-243b9a8b07b5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:13.200755 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5660fd40-244c-4479-9216-243b9a8b07b5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:13.202291 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5660fd40-244c-4479-9216-243b9a8b07b5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:13.203456 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5660fd40-244c-4479-9216-243b9a8b07b5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1408 microversion: 2.20 time: 0.158779 Nov 23 04:19:13.204019 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 351/762] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:13 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:14.221309 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e8420eb6-e5b1-45f7-bc2d-132bb841e1c7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:14.221933 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e8420eb6-e5b1-45f7-bc2d-132bb841e1c7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:14.228530 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8420eb6-e5b1-45f7-bc2d-132bb841e1c7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:14.229082 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8420eb6-e5b1-45f7-bc2d-132bb841e1c7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:14.229997 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8420eb6-e5b1-45f7-bc2d-132bb841e1c7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:14.230364 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8420eb6-e5b1-45f7-bc2d-132bb841e1c7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:14.364272 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e8420eb6-e5b1-45f7-bc2d-132bb841e1c7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:14.372912 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e8420eb6-e5b1-45f7-bc2d-132bb841e1c7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:14.374621 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e8420eb6-e5b1-45f7-bc2d-132bb841e1c7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:14.375774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e8420eb6-e5b1-45f7-bc2d-132bb841e1c7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1408 microversion: 2.20 time: 0.158424 Nov 23 04:19:14.376320 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 412/763] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:14 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:15.393790 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8786747c-70e7-4bf2-b1f8-039961f1a2d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:15.394534 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8786747c-70e7-4bf2-b1f8-039961f1a2d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:15.402084 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8786747c-70e7-4bf2-b1f8-039961f1a2d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:15.402622 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8786747c-70e7-4bf2-b1f8-039961f1a2d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:15.403393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8786747c-70e7-4bf2-b1f8-039961f1a2d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:15.403781 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8786747c-70e7-4bf2-b1f8-039961f1a2d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:15.543276 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8786747c-70e7-4bf2-b1f8-039961f1a2d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:15.551385 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8786747c-70e7-4bf2-b1f8-039961f1a2d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:15.553275 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8786747c-70e7-4bf2-b1f8-039961f1a2d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:15.554385 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8786747c-70e7-4bf2-b1f8-039961f1a2d1 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1408 microversion: 2.20 time: 0.164567 Nov 23 04:19:15.554941 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 352/764] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:15 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:16.572670 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a4e3e1c2-fa0b-4335-b563-9b0facf6429d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:16.573305 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a4e3e1c2-fa0b-4335-b563-9b0facf6429d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:16.580063 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4e3e1c2-fa0b-4335-b563-9b0facf6429d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:16.580452 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4e3e1c2-fa0b-4335-b563-9b0facf6429d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:16.581607 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4e3e1c2-fa0b-4335-b563-9b0facf6429d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:16.582049 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a4e3e1c2-fa0b-4335-b563-9b0facf6429d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:16.873600 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a4e3e1c2-fa0b-4335-b563-9b0facf6429d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:16.881843 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a4e3e1c2-fa0b-4335-b563-9b0facf6429d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:16.883337 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a4e3e1c2-fa0b-4335-b563-9b0facf6429d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:16.884464 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a4e3e1c2-fa0b-4335-b563-9b0facf6429d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1408 microversion: 2.20 time: 0.315682 Nov 23 04:19:16.885018 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 413/765] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:16 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:17.858233 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-8bfce344-0ebd-4f08-b270-9b9e4b2dd7ee req-e1313b3d-1107-490c-a428-47954c8c7eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2542af4-c4d5-4fc0-b86c-00df6da8fd61", "name": "network-vif-plugged", "status": "completed", "tag": "ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:17.860015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:19:17.860015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:19:17.867504 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-8bfce344-0ebd-4f08-b270-9b9e4b2dd7ee req-e1313b3d-1107-490c-a428-47954c8c7eed service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:17.868004 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-8bfce344-0ebd-4f08-b270-9b9e4b2dd7ee req-e1313b3d-1107-490c-a428-47954c8c7eed service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:17.878992 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-8bfce344-0ebd-4f08-b270-9b9e4b2dd7ee req-e1313b3d-1107-490c-a428-47954c8c7eed service nova] Creating event network-vif-plugged:ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673 for instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 on hv-cinder-76845 Nov 23 04:19:17.885068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-8bfce344-0ebd-4f08-b270-9b9e4b2dd7ee req-e1313b3d-1107-490c-a428-47954c8c7eed service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031020 Nov 23 04:19:17.885691 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 353/766] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:19:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:19:17.903190 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6a3e7202-262d-426b-b7c6-67c3002f715b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:17.903810 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6a3e7202-262d-426b-b7c6-67c3002f715b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:17.910337 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6a3e7202-262d-426b-b7c6-67c3002f715b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:17.910780 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6a3e7202-262d-426b-b7c6-67c3002f715b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:17.911846 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6a3e7202-262d-426b-b7c6-67c3002f715b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:17.912582 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6a3e7202-262d-426b-b7c6-67c3002f715b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:18.066025 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6a3e7202-262d-426b-b7c6-67c3002f715b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:18.074697 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6a3e7202-262d-426b-b7c6-67c3002f715b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:18.076200 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6a3e7202-262d-426b-b7c6-67c3002f715b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:18.077291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6a3e7202-262d-426b-b7c6-67c3002f715b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1408 microversion: 2.20 time: 0.177931 Nov 23 04:19:18.077841 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 414/767] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:17 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:19.097536 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-28d4e75e-fac2-40ac-b3bd-c8d600bf33ef tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:19.098236 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-28d4e75e-fac2-40ac-b3bd-c8d600bf33ef tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:19.104957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-28d4e75e-fac2-40ac-b3bd-c8d600bf33ef tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:19.105397 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-28d4e75e-fac2-40ac-b3bd-c8d600bf33ef tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:19.106253 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-28d4e75e-fac2-40ac-b3bd-c8d600bf33ef tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:19.106684 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-28d4e75e-fac2-40ac-b3bd-c8d600bf33ef tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:19.314408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-28d4e75e-fac2-40ac-b3bd-c8d600bf33ef tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:19.323000 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-28d4e75e-fac2-40ac-b3bd-c8d600bf33ef tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:19.324659 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-28d4e75e-fac2-40ac-b3bd-c8d600bf33ef tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:19.325845 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-28d4e75e-fac2-40ac-b3bd-c8d600bf33ef tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1408 microversion: 2.20 time: 0.232838 Nov 23 04:19:19.326494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 354/768] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:19 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:20.344502 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-52d1d4f7-4a1f-4f71-af0a-3485c01bff87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:20.345137 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-52d1d4f7-4a1f-4f71-af0a-3485c01bff87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:20.351496 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52d1d4f7-4a1f-4f71-af0a-3485c01bff87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:20.351956 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52d1d4f7-4a1f-4f71-af0a-3485c01bff87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:20.352704 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52d1d4f7-4a1f-4f71-af0a-3485c01bff87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:20.353136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52d1d4f7-4a1f-4f71-af0a-3485c01bff87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:20.488336 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-52d1d4f7-4a1f-4f71-af0a-3485c01bff87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:20.497302 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-52d1d4f7-4a1f-4f71-af0a-3485c01bff87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:20.500129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-52d1d4f7-4a1f-4f71-af0a-3485c01bff87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:20.500129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-52d1d4f7-4a1f-4f71-af0a-3485c01bff87 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1599 microversion: 2.20 time: 0.159153 Nov 23 04:19:20.500598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 415/769] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:19:20 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:20.518557 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5aa56bf1-ea65-4a4f-951a-c8582863da2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:20.519059 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5aa56bf1-ea65-4a4f-951a-c8582863da2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:20.525805 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5aa56bf1-ea65-4a4f-951a-c8582863da2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:20.528792 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5aa56bf1-ea65-4a4f-951a-c8582863da2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:20.528792 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5aa56bf1-ea65-4a4f-951a-c8582863da2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:20.528792 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5aa56bf1-ea65-4a4f-951a-c8582863da2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:20.610556 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5aa56bf1-ea65-4a4f-951a-c8582863da2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095690 Nov 23 04:19:20.611148 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 355/770] 10.222.0.54 () {60 vars in 1315 bytes} [Tue Nov 23 04:19:20 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:19:21.816272 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-db0b5592-c61f-4052-9f7f-cd23a2ab9966 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:21.817249 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-db0b5592-c61f-4052-9f7f-cd23a2ab9966 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:21.820167 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-46a3942c-c540-45c2-95ea-15b0d2a31b8a req-691efd92-6a0d-4c63-ae87-3748150acebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2542af4-c4d5-4fc0-b86c-00df6da8fd61", "tag": "ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:21.821785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:19:21.821785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:19:21.824827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-db0b5592-c61f-4052-9f7f-cd23a2ab9966 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:21.825274 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-db0b5592-c61f-4052-9f7f-cd23a2ab9966 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:21.826061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-db0b5592-c61f-4052-9f7f-cd23a2ab9966 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:21.826490 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-db0b5592-c61f-4052-9f7f-cd23a2ab9966 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:21.829565 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-46a3942c-c540-45c2-95ea-15b0d2a31b8a req-691efd92-6a0d-4c63-ae87-3748150acebf service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:21.830171 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-46a3942c-c540-45c2-95ea-15b0d2a31b8a req-691efd92-6a0d-4c63-ae87-3748150acebf service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:21.842078 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-46a3942c-c540-45c2-95ea-15b0d2a31b8a req-691efd92-6a0d-4c63-ae87-3748150acebf service nova] Creating event network-changed:ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673 for instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 on hv-cinder-76845 Nov 23 04:19:21.847359 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-46a3942c-c540-45c2-95ea-15b0d2a31b8a req-691efd92-6a0d-4c63-ae87-3748150acebf service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032368 Nov 23 04:19:21.848489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 356/771] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:19:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:19:21.951255 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-db0b5592-c61f-4052-9f7f-cd23a2ab9966 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.138630 Nov 23 04:19:21.954905 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 416/772] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:21 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:22.963673 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bb0b7838-08c5-4b16-be79-0fdbbf7e0372 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:22.964808 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-bb0b7838-08c5-4b16-be79-0fdbbf7e0372 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:22.970865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bb0b7838-08c5-4b16-be79-0fdbbf7e0372 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:22.971344 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bb0b7838-08c5-4b16-be79-0fdbbf7e0372 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:22.972139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bb0b7838-08c5-4b16-be79-0fdbbf7e0372 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:22.972577 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bb0b7838-08c5-4b16-be79-0fdbbf7e0372 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:23.063408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bb0b7838-08c5-4b16-be79-0fdbbf7e0372 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.104774 Nov 23 04:19:23.066587 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 357/773] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:22 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:24.076899 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-95aa2f66-198e-4586-8cee-e6515f2212cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:24.078070 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-95aa2f66-198e-4586-8cee-e6515f2212cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:24.086244 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-95aa2f66-198e-4586-8cee-e6515f2212cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:24.087111 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-95aa2f66-198e-4586-8cee-e6515f2212cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:24.088196 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-95aa2f66-198e-4586-8cee-e6515f2212cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:24.088788 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-95aa2f66-198e-4586-8cee-e6515f2212cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:24.177788 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-95aa2f66-198e-4586-8cee-e6515f2212cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.105776 Nov 23 04:19:24.180934 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 417/774] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:24 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:25.356772 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-27429d0c-89cd-411e-8bb2-f9b2d96284e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:25.357812 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-27429d0c-89cd-411e-8bb2-f9b2d96284e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:25.363762 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-27429d0c-89cd-411e-8bb2-f9b2d96284e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:25.365084 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-27429d0c-89cd-411e-8bb2-f9b2d96284e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:25.366503 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-27429d0c-89cd-411e-8bb2-f9b2d96284e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:25.366902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-27429d0c-89cd-411e-8bb2-f9b2d96284e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:25.491370 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-27429d0c-89cd-411e-8bb2-f9b2d96284e6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.305984 Nov 23 04:19:25.492632 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 358/775] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:25 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:26.506711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6aa89b4b-913d-40f8-9ef4-b8350ac348cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:26.509745 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6aa89b4b-913d-40f8-9ef4-b8350ac348cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:26.519092 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6aa89b4b-913d-40f8-9ef4-b8350ac348cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:26.519643 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6aa89b4b-913d-40f8-9ef4-b8350ac348cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:26.520952 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6aa89b4b-913d-40f8-9ef4-b8350ac348cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:26.521506 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6aa89b4b-913d-40f8-9ef4-b8350ac348cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:26.606835 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6aa89b4b-913d-40f8-9ef4-b8350ac348cc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.104332 Nov 23 04:19:26.607497 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 418/776] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:26 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:27.624691 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9facde09-13ae-4d6d-906d-2593bc791280 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:27.624691 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9facde09-13ae-4d6d-906d-2593bc791280 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:27.627120 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9facde09-13ae-4d6d-906d-2593bc791280 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:27.627597 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9facde09-13ae-4d6d-906d-2593bc791280 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:27.628368 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9facde09-13ae-4d6d-906d-2593bc791280 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:27.628793 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9facde09-13ae-4d6d-906d-2593bc791280 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:27.713752 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9facde09-13ae-4d6d-906d-2593bc791280 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.099173 Nov 23 04:19:27.714399 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 359/777] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:27 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:28.725685 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5f006929-7c3f-4e7e-9e87-d6b663496c19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:28.726676 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5f006929-7c3f-4e7e-9e87-d6b663496c19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:28.733745 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f006929-7c3f-4e7e-9e87-d6b663496c19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:28.734276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f006929-7c3f-4e7e-9e87-d6b663496c19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:28.735297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f006929-7c3f-4e7e-9e87-d6b663496c19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:28.735861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f006929-7c3f-4e7e-9e87-d6b663496c19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:28.834901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5f006929-7c3f-4e7e-9e87-d6b663496c19 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.113514 Nov 23 04:19:28.838160 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 419/778] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:28 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:29.846346 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8114cc4e-9f27-4a08-a105-cc965a652c66 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:29.847387 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8114cc4e-9f27-4a08-a105-cc965a652c66 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:29.854948 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8114cc4e-9f27-4a08-a105-cc965a652c66 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:29.855427 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8114cc4e-9f27-4a08-a105-cc965a652c66 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:29.856195 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8114cc4e-9f27-4a08-a105-cc965a652c66 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:29.856625 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8114cc4e-9f27-4a08-a105-cc965a652c66 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:29.937068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8114cc4e-9f27-4a08-a105-cc965a652c66 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.094526 Nov 23 04:19:29.937690 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 360/779] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:29 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:30.948383 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-20ff213a-4c92-4d4f-867c-59c3fe3e69f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:30.949384 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-20ff213a-4c92-4d4f-867c-59c3fe3e69f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:30.956288 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20ff213a-4c92-4d4f-867c-59c3fe3e69f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:30.956732 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20ff213a-4c92-4d4f-867c-59c3fe3e69f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:30.957529 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20ff213a-4c92-4d4f-867c-59c3fe3e69f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:30.957946 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20ff213a-4c92-4d4f-867c-59c3fe3e69f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:31.054283 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-20ff213a-4c92-4d4f-867c-59c3fe3e69f7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.110486 Nov 23 04:19:31.057576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 420/780] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:30 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:32.065881 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-971109cd-c695-4fb7-bd24-e68dd722d7f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:32.066872 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-971109cd-c695-4fb7-bd24-e68dd722d7f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:32.075112 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-971109cd-c695-4fb7-bd24-e68dd722d7f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:32.075748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-971109cd-c695-4fb7-bd24-e68dd722d7f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:32.076341 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-971109cd-c695-4fb7-bd24-e68dd722d7f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:32.076744 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-971109cd-c695-4fb7-bd24-e68dd722d7f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:32.175712 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-971109cd-c695-4fb7-bd24-e68dd722d7f4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.114142 Nov 23 04:19:32.177987 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 361/781] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:32 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:33.186276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-eeaf041f-cafa-4595-ab73-6aa9cc044a4e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:33.187291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-eeaf041f-cafa-4595-ab73-6aa9cc044a4e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:33.194190 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eeaf041f-cafa-4595-ab73-6aa9cc044a4e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:33.194628 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eeaf041f-cafa-4595-ab73-6aa9cc044a4e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:33.195442 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eeaf041f-cafa-4595-ab73-6aa9cc044a4e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:33.195872 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eeaf041f-cafa-4595-ab73-6aa9cc044a4e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:33.293334 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-eeaf041f-cafa-4595-ab73-6aa9cc044a4e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 14 microversion: 2.20 time: 0.110693 Nov 23 04:19:33.294035 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 421/782] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:33 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:34.305934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c5ccdf4a-7bd3-4b4c-b16e-7c1eabb73ba5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:34.306960 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c5ccdf4a-7bd3-4b4c-b16e-7c1eabb73ba5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:34.314075 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c5ccdf4a-7bd3-4b4c-b16e-7c1eabb73ba5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:34.314530 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c5ccdf4a-7bd3-4b4c-b16e-7c1eabb73ba5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:34.315507 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c5ccdf4a-7bd3-4b4c-b16e-7c1eabb73ba5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:34.315958 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c5ccdf4a-7bd3-4b4c-b16e-7c1eabb73ba5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:34.416956 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c5ccdf4a-7bd3-4b4c-b16e-7c1eabb73ba5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 6451 microversion: 2.20 time: 0.116106 Nov 23 04:19:34.417960 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 362/783] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:34 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 6451 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:19:35.429661 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-30971bd9-e461-4be1-98aa-a3831f77de21 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:35.430692 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-30971bd9-e461-4be1-98aa-a3831f77de21 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:35.437542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-30971bd9-e461-4be1-98aa-a3831f77de21 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:35.438027 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-30971bd9-e461-4be1-98aa-a3831f77de21 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:35.438806 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-30971bd9-e461-4be1-98aa-a3831f77de21 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:35.439272 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-30971bd9-e461-4be1-98aa-a3831f77de21 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:35.540812 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-30971bd9-e461-4be1-98aa-a3831f77de21 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 15025 microversion: 2.20 time: 0.115790 Nov 23 04:19:35.541454 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 422/784] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:35 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 15025 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:36.552463 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-76e66836-eade-471d-90ea-db2f6018fd47 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:36.554100 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-76e66836-eade-471d-90ea-db2f6018fd47 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:36.561384 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-76e66836-eade-471d-90ea-db2f6018fd47 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:36.561830 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-76e66836-eade-471d-90ea-db2f6018fd47 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:36.563996 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-76e66836-eade-471d-90ea-db2f6018fd47 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:36.563996 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-76e66836-eade-471d-90ea-db2f6018fd47 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:36.662577 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-76e66836-eade-471d-90ea-db2f6018fd47 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 18257 microversion: 2.20 time: 0.113379 Nov 23 04:19:36.663233 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 363/785] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:36 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 18257 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:37.674433 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-47f0727c-85b1-4f6c-a7f4-556eb6385ca3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:37.675420 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-47f0727c-85b1-4f6c-a7f4-556eb6385ca3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:37.682874 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47f0727c-85b1-4f6c-a7f4-556eb6385ca3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:37.683362 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47f0727c-85b1-4f6c-a7f4-556eb6385ca3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:37.684138 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47f0727c-85b1-4f6c-a7f4-556eb6385ca3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:37.684566 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47f0727c-85b1-4f6c-a7f4-556eb6385ca3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:37.784915 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-47f0727c-85b1-4f6c-a7f4-556eb6385ca3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 19342 microversion: 2.20 time: 0.114410 Nov 23 04:19:37.785546 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 423/786] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:37 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 19342 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:38.798660 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3799d395-297d-4ab6-9b70-bc540c62ea2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:38.799704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3799d395-297d-4ab6-9b70-bc540c62ea2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:38.806727 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3799d395-297d-4ab6-9b70-bc540c62ea2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:38.807579 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3799d395-297d-4ab6-9b70-bc540c62ea2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:38.808444 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3799d395-297d-4ab6-9b70-bc540c62ea2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:38.808844 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3799d395-297d-4ab6-9b70-bc540c62ea2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:38.905579 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3799d395-297d-4ab6-9b70-bc540c62ea2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 21935 microversion: 2.20 time: 0.109900 Nov 23 04:19:38.905579 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 364/787] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:38 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 21935 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:39.921202 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0681e937-cc1d-46b6-929e-1f0ac26497dc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:39.921202 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0681e937-cc1d-46b6-929e-1f0ac26497dc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:39.925860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0681e937-cc1d-46b6-929e-1f0ac26497dc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:39.926313 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0681e937-cc1d-46b6-929e-1f0ac26497dc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:39.927333 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0681e937-cc1d-46b6-929e-1f0ac26497dc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:39.927860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0681e937-cc1d-46b6-929e-1f0ac26497dc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:40.021665 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0681e937-cc1d-46b6-929e-1f0ac26497dc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 23235 microversion: 2.20 time: 0.108877 Nov 23 04:19:40.022582 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 424/788] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:39 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 23235 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:41.033806 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-96c3f535-dac7-4282-b535-93b59e192a2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:41.034727 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-96c3f535-dac7-4282-b535-93b59e192a2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:41.042185 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-96c3f535-dac7-4282-b535-93b59e192a2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:41.042631 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-96c3f535-dac7-4282-b535-93b59e192a2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:41.043466 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-96c3f535-dac7-4282-b535-93b59e192a2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:41.043908 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-96c3f535-dac7-4282-b535-93b59e192a2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:41.140168 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-96c3f535-dac7-4282-b535-93b59e192a2c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 24619 microversion: 2.20 time: 0.110177 Nov 23 04:19:41.140814 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 365/789] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:41 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 24619 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:42.157749 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-92ef92e6-5d3a-4b2e-96c2-aa80c75b1ee0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:42.158746 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-92ef92e6-5d3a-4b2e-96c2-aa80c75b1ee0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:42.167048 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-92ef92e6-5d3a-4b2e-96c2-aa80c75b1ee0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:42.167558 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-92ef92e6-5d3a-4b2e-96c2-aa80c75b1ee0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:42.168382 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-92ef92e6-5d3a-4b2e-96c2-aa80c75b1ee0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:42.168827 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-92ef92e6-5d3a-4b2e-96c2-aa80c75b1ee0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:42.267144 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-92ef92e6-5d3a-4b2e-96c2-aa80c75b1ee0 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 26053 microversion: 2.20 time: 0.113253 Nov 23 04:19:42.267870 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 425/790] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:42 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 26053 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:43.087098 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-eb0dd3f2-e1d7-4afa-ab1b-59145ea9fff4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1771096911"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:43.087693 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-eb0dd3f2-e1d7-4afa-ab1b-59145ea9fff4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:43.094449 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb0dd3f2-e1d7-4afa-ab1b-59145ea9fff4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:43.094902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb0dd3f2-e1d7-4afa-ab1b-59145ea9fff4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:43.095740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb0dd3f2-e1d7-4afa-ab1b-59145ea9fff4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:43.096186 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb0dd3f2-e1d7-4afa-ab1b-59145ea9fff4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:43.238947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.network.security_group_api [None req-eb0dd3f2-e1d7-4afa-ab1b-59145ea9fff4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Removing security group 33fb836f-8629-4586-a9ba-f4b64fc1791c from port 5dc60928-ecbb-432d-abab-7e8074ff19f9 Nov 23 04:19:43.279005 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c1192d11-f4c8-4639-bff3-180754885d3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:43.280765 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c1192d11-f4c8-4639-bff3-180754885d3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:43.288084 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1192d11-f4c8-4639-bff3-180754885d3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:43.288541 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1192d11-f4c8-4639-bff3-180754885d3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:43.289345 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1192d11-f4c8-4639-bff3-180754885d3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:43.289784 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1192d11-f4c8-4639-bff3-180754885d3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:43.412962 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c1192d11-f4c8-4639-bff3-180754885d3e tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 27282 microversion: 2.20 time: 0.131878 Nov 23 04:19:43.412962 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 426/791] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:43 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 27282 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:19:43.797446 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-eb0dd3f2-e1d7-4afa-ab1b-59145ea9fff4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "POST /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/action" status: 202 len: 0 microversion: 2.1 time: 0.715286 Nov 23 04:19:43.798061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 366/792] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:19:43 2021] POST /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:44.058823 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-fdab7868-c407-4ac5-ba93-37e8ec96730b req-e5c1ae97-ed6a-4759-8220-0a107f4de748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f1f74c-599b-40e5-aed9-cf063b9c46ac", "tag": "5dc60928-ecbb-432d-abab-7e8074ff19f9"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:44.063734 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:19:44.063734 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:19:44.087290 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-fdab7868-c407-4ac5-ba93-37e8ec96730b req-e5c1ae97-ed6a-4759-8220-0a107f4de748 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:44.093885 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-fdab7868-c407-4ac5-ba93-37e8ec96730b req-e5c1ae97-ed6a-4759-8220-0a107f4de748 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:44.104635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-fdab7868-c407-4ac5-ba93-37e8ec96730b req-e5c1ae97-ed6a-4759-8220-0a107f4de748 service nova] Creating event network-changed:5dc60928-ecbb-432d-abab-7e8074ff19f9 for instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac on hv-cinder-76845 Nov 23 04:19:44.110484 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-fdab7868-c407-4ac5-ba93-37e8ec96730b req-e5c1ae97-ed6a-4759-8220-0a107f4de748 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300500 Nov 23 04:19:44.111088 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 427/793] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:19:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:19:44.420533 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c48be129-98ed-4826-8991-75cf17820c46 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:44.421599 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c48be129-98ed-4826-8991-75cf17820c46 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:44.434328 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c48be129-98ed-4826-8991-75cf17820c46 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:44.435093 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c48be129-98ed-4826-8991-75cf17820c46 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:44.436130 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c48be129-98ed-4826-8991-75cf17820c46 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:44.436926 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c48be129-98ed-4826-8991-75cf17820c46 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:44.541335 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c48be129-98ed-4826-8991-75cf17820c46 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 27987 microversion: 2.20 time: 0.124753 Nov 23 04:19:44.542659 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 367/794] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:44 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 27987 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:45.555438 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-696c77eb-81e8-44c9-aaf1-f4337740995c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:45.557259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-696c77eb-81e8-44c9-aaf1-f4337740995c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:45.565236 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-696c77eb-81e8-44c9-aaf1-f4337740995c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:45.565772 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-696c77eb-81e8-44c9-aaf1-f4337740995c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:45.566693 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-696c77eb-81e8-44c9-aaf1-f4337740995c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:45.567432 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-696c77eb-81e8-44c9-aaf1-f4337740995c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:45.663741 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-696c77eb-81e8-44c9-aaf1-f4337740995c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 28176 microversion: 2.20 time: 0.112707 Nov 23 04:19:45.670460 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 428/795] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:45 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 28176 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:45.870493 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-093151b8-7fa9-49c2-8182-57335b1af7f4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:45.871774 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-093151b8-7fa9-49c2-8182-57335b1af7f4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:45.889568 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-093151b8-7fa9-49c2-8182-57335b1af7f4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:45.891522 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-093151b8-7fa9-49c2-8182-57335b1af7f4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:45.892729 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-093151b8-7fa9-49c2-8182-57335b1af7f4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:45.897007 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-093151b8-7fa9-49c2-8182-57335b1af7f4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:45.998579 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-7f658c44-9fdd-49c8-80fc-bfc28bc39058 req-8361f83a-ca53-43d1-8430-b6a0cb550856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7f1f74c-599b-40e5-aed9-cf063b9c46ac", "tag": "5dc60928-ecbb-432d-abab-7e8074ff19f9"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:46.000096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:19:46.000096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:19:46.012799 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-7f658c44-9fdd-49c8-80fc-bfc28bc39058 req-8361f83a-ca53-43d1-8430-b6a0cb550856 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:46.013632 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-7f658c44-9fdd-49c8-80fc-bfc28bc39058 req-8361f83a-ca53-43d1-8430-b6a0cb550856 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:46.025742 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-7f658c44-9fdd-49c8-80fc-bfc28bc39058 req-8361f83a-ca53-43d1-8430-b6a0cb550856 service nova] Creating event network-changed:5dc60928-ecbb-432d-abab-7e8074ff19f9 for instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac on hv-cinder-76845 Nov 23 04:19:46.031884 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-7f658c44-9fdd-49c8-80fc-bfc28bc39058 req-8361f83a-ca53-43d1-8430-b6a0cb550856 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159927 Nov 23 04:19:46.038389 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 429/796] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:19:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:19:46.051108 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-093151b8-7fa9-49c2-8182-57335b1af7f4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lazy-loading 'services' on Instance uuid e7f1f74c-599b-40e5-aed9-cf063b9c46ac {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:19:46.299941 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-093151b8-7fa9-49c2-8182-57335b1af7f4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "DELETE /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments/023a514b-c26c-4af7-9de5-4007d6dc73d8" status: 202 len: 0 microversion: 2.1 time: 0.433288 Nov 23 04:19:46.301127 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 368/797] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:19:45 2021] DELETE /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments/023a514b-c26c-4af7-9de5-4007d6dc73d8 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:46.316650 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a9d03977-2563-46ab-b70b-99821d9f38b5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:46.318076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a9d03977-2563-46ab-b70b-99821d9f38b5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:46.326952 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a9d03977-2563-46ab-b70b-99821d9f38b5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:46.327861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a9d03977-2563-46ab-b70b-99821d9f38b5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:46.329274 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a9d03977-2563-46ab-b70b-99821d9f38b5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:46.330398 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a9d03977-2563-46ab-b70b-99821d9f38b5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:46.365969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a9d03977-2563-46ab-b70b-99821d9f38b5 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057264 Nov 23 04:19:46.366863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 430/798] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:19:46 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:19:46.680827 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-09bf13e9-e3c8-4986-8186-7d45d98a17d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:46.681417 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-09bf13e9-e3c8-4986-8186-7d45d98a17d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:46.701053 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-09bf13e9-e3c8-4986-8186-7d45d98a17d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:46.702416 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-09bf13e9-e3c8-4986-8186-7d45d98a17d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:46.704742 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-09bf13e9-e3c8-4986-8186-7d45d98a17d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:46.705472 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-09bf13e9-e3c8-4986-8186-7d45d98a17d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:46.832476 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-09bf13e9-e3c8-4986-8186-7d45d98a17d3 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 28176 microversion: 2.20 time: 0.156265 Nov 23 04:19:46.838648 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 369/799] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:46 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 28176 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:47.379347 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7caf10b3-7327-4138-82f0-5b7b8cdec8c7 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:47.381853 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7caf10b3-7327-4138-82f0-5b7b8cdec8c7 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:47.389238 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7caf10b3-7327-4138-82f0-5b7b8cdec8c7 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:47.389698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7caf10b3-7327-4138-82f0-5b7b8cdec8c7 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:47.390499 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7caf10b3-7327-4138-82f0-5b7b8cdec8c7 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:47.390935 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7caf10b3-7327-4138-82f0-5b7b8cdec8c7 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:47.460860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7caf10b3-7327-4138-82f0-5b7b8cdec8c7 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080141 Nov 23 04:19:47.461729 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 431/800] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:19:47 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:19:47.846906 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7cfdb086-6f4f-4ae7-8a24-5fbfc7df8e7d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:47.849437 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7cfdb086-6f4f-4ae7-8a24-5fbfc7df8e7d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:47.873217 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7cfdb086-6f4f-4ae7-8a24-5fbfc7df8e7d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:47.873936 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7cfdb086-6f4f-4ae7-8a24-5fbfc7df8e7d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:47.875175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7cfdb086-6f4f-4ae7-8a24-5fbfc7df8e7d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:47.875922 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7cfdb086-6f4f-4ae7-8a24-5fbfc7df8e7d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:47.995605 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7cfdb086-6f4f-4ae7-8a24-5fbfc7df8e7d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 28467 microversion: 2.20 time: 0.152520 Nov 23 04:19:47.996576 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 370/801] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:47 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 28467 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:48.471998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1a108b7a-f61d-4911-8435-64bd5b023764 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:48.472919 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1a108b7a-f61d-4911-8435-64bd5b023764 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:48.479823 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a108b7a-f61d-4911-8435-64bd5b023764 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:48.480273 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a108b7a-f61d-4911-8435-64bd5b023764 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:48.481061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a108b7a-f61d-4911-8435-64bd5b023764 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:48.481563 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a108b7a-f61d-4911-8435-64bd5b023764 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:48.511316 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1a108b7a-f61d-4911-8435-64bd5b023764 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043099 Nov 23 04:19:48.511910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 432/802] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:19:48 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:19:48.522151 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-45db8963-e2b9-4246-ad3a-15d68830fcfd tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:48.522748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-45db8963-e2b9-4246-ad3a-15d68830fcfd tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:48.529722 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-45db8963-e2b9-4246-ad3a-15d68830fcfd tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:48.530178 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-45db8963-e2b9-4246-ad3a-15d68830fcfd tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:48.538223 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-45db8963-e2b9-4246-ad3a-15d68830fcfd tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:48.538223 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-45db8963-e2b9-4246-ad3a-15d68830fcfd tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:48.607744 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-45db8963-e2b9-4246-ad3a-15d68830fcfd tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] HTTP exception thrown: Instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac is not attached to volume 023a514b-c26c-4af7-9de5-4007d6dc73d8 Nov 23 04:19:48.608335 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-45db8963-e2b9-4246-ad3a-15d68830fcfd tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Returning 404 to user: Instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac is not attached to volume 023a514b-c26c-4af7-9de5-4007d6dc73d8 {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:19:48.609168 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-45db8963-e2b9-4246-ad3a-15d68830fcfd tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "DELETE /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments/023a514b-c26c-4af7-9de5-4007d6dc73d8" status: 404 len: 154 microversion: 2.1 time: 0.091296 Nov 23 04:19:48.609771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 371/803] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:19:48 2021] DELETE /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac/os-volume_attachments/023a514b-c26c-4af7-9de5-4007d6dc73d8 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:19:49.009612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2517bf88-2080-4d93-b2f9-dd15b91c461c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:49.010531 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2517bf88-2080-4d93-b2f9-dd15b91c461c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:49.016421 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2517bf88-2080-4d93-b2f9-dd15b91c461c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:49.017050 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2517bf88-2080-4d93-b2f9-dd15b91c461c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:49.018055 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2517bf88-2080-4d93-b2f9-dd15b91c461c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:49.018499 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2517bf88-2080-4d93-b2f9-dd15b91c461c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:49.119913 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2517bf88-2080-4d93-b2f9-dd15b91c461c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 28635 microversion: 2.20 time: 0.114598 Nov 23 04:19:49.121118 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 433/804] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:49 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 28635 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:49.899501 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4d41a4f6-c197-45a2-89a0-9c794d4512a4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:49.901079 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4d41a4f6-c197-45a2-89a0-9c794d4512a4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:49.908339 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d41a4f6-c197-45a2-89a0-9c794d4512a4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:49.909042 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d41a4f6-c197-45a2-89a0-9c794d4512a4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:49.910003 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d41a4f6-c197-45a2-89a0-9c794d4512a4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:49.910700 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d41a4f6-c197-45a2-89a0-9c794d4512a4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:49.964092 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4d41a4f6-c197-45a2-89a0-9c794d4512a4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Going to try to terminate instance {{(pid=116837) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:19:50.132882 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f7fa48db-443c-4649-9061-1ba7a2fa001c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:50.133871 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f7fa48db-443c-4649-9061-1ba7a2fa001c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:50.149969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f7fa48db-443c-4649-9061-1ba7a2fa001c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:50.155234 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f7fa48db-443c-4649-9061-1ba7a2fa001c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:50.155234 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f7fa48db-443c-4649-9061-1ba7a2fa001c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:50.155234 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f7fa48db-443c-4649-9061-1ba7a2fa001c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:50.262410 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f7fa48db-443c-4649-9061-1ba7a2fa001c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 28635 microversion: 2.20 time: 0.133419 Nov 23 04:19:50.264345 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 434/805] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:50 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 28635 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:19:50.421671 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4d41a4f6-c197-45a2-89a0-9c794d4512a4 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "DELETE /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 204 len: 0 microversion: 2.1 time: 0.526019 Nov 23 04:19:50.422408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 372/806] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:19:49 2021] DELETE /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:19:50.431639 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-75122b45-e751-41fb-9d18-2e980a924c97 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:50.432810 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-75122b45-e751-41fb-9d18-2e980a924c97 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:50.438573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-75122b45-e751-41fb-9d18-2e980a924c97 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:50.439025 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-75122b45-e751-41fb-9d18-2e980a924c97 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:50.439851 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-75122b45-e751-41fb-9d18-2e980a924c97 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:50.440289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-75122b45-e751-41fb-9d18-2e980a924c97 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:50.755010 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-75122b45-e751-41fb-9d18-2e980a924c97 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:50.764579 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-75122b45-e751-41fb-9d18-2e980a924c97 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1552 microversion: 2.1 time: 0.337240 Nov 23 04:19:50.774630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 435/807] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:50 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1552 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:51.277275 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-281da46f-9e55-4fb3-9b78-16868efccc16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:51.288794 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-281da46f-9e55-4fb3-9b78-16868efccc16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:51.292621 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-281da46f-9e55-4fb3-9b78-16868efccc16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:51.293381 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-281da46f-9e55-4fb3-9b78-16868efccc16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:51.294271 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-281da46f-9e55-4fb3-9b78-16868efccc16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:51.294770 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-281da46f-9e55-4fb3-9b78-16868efccc16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:51.392594 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-281da46f-9e55-4fb3-9b78-16868efccc16 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 28635 microversion: 2.20 time: 0.120661 Nov 23 04:19:51.397999 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 373/808] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:51 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 28635 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:51.781769 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-acc61a0a-aaef-4a95-bb3e-74365c667f4b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:51.787191 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-acc61a0a-aaef-4a95-bb3e-74365c667f4b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:51.791677 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acc61a0a-aaef-4a95-bb3e-74365c667f4b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:51.792116 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acc61a0a-aaef-4a95-bb3e-74365c667f4b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:51.792915 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acc61a0a-aaef-4a95-bb3e-74365c667f4b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:51.802332 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-acc61a0a-aaef-4a95-bb3e-74365c667f4b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:52.003086 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-acc61a0a-aaef-4a95-bb3e-74365c667f4b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:52.011552 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-acc61a0a-aaef-4a95-bb3e-74365c667f4b tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1552 microversion: 2.1 time: 0.233198 Nov 23 04:19:52.012445 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 436/809] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:51 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:19:52.405514 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-188fc9f4-a209-413b-8c97-a6996af75e1c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:52.406910 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-188fc9f4-a209-413b-8c97-a6996af75e1c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:52.414917 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-188fc9f4-a209-413b-8c97-a6996af75e1c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:52.415484 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-188fc9f4-a209-413b-8c97-a6996af75e1c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:52.416382 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-188fc9f4-a209-413b-8c97-a6996af75e1c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:52.416892 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-188fc9f4-a209-413b-8c97-a6996af75e1c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:52.527369 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-188fc9f4-a209-413b-8c97-a6996af75e1c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 29719 microversion: 2.20 time: 0.125982 Nov 23 04:19:52.528460 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 374/810] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:52 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 29719 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:53.029847 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c4345674-7b7f-47ae-ae90-041c9ef4dc3a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:53.030648 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c4345674-7b7f-47ae-ae90-041c9ef4dc3a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:53.037028 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c4345674-7b7f-47ae-ae90-041c9ef4dc3a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:53.041044 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c4345674-7b7f-47ae-ae90-041c9ef4dc3a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:53.041044 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c4345674-7b7f-47ae-ae90-041c9ef4dc3a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:53.041044 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c4345674-7b7f-47ae-ae90-041c9ef4dc3a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:53.167353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c4345674-7b7f-47ae-ae90-041c9ef4dc3a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:53.184628 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c4345674-7b7f-47ae-ae90-041c9ef4dc3a tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1510 microversion: 2.1 time: 0.158493 Nov 23 04:19:53.185888 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 437/811] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:53 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:53.268591 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-a3edc147-2fda-4c91-b7d9-f8fbe8aa62b4 req-a1e5cd92-b7a2-4ae9-b605-5abf7868c1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7f1f74c-599b-40e5-aed9-cf063b9c46ac", "name": "network-vif-deleted", "tag": "5dc60928-ecbb-432d-abab-7e8074ff19f9"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:53.270666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:19:53.270666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:19:53.279175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-a3edc147-2fda-4c91-b7d9-f8fbe8aa62b4 req-a1e5cd92-b7a2-4ae9-b605-5abf7868c1a5 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:53.280529 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-a3edc147-2fda-4c91-b7d9-f8fbe8aa62b4 req-a1e5cd92-b7a2-4ae9-b605-5abf7868c1a5 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:53.305391 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-a3edc147-2fda-4c91-b7d9-f8fbe8aa62b4 req-a1e5cd92-b7a2-4ae9-b605-5abf7868c1a5 service nova] Creating event network-vif-deleted:5dc60928-ecbb-432d-abab-7e8074ff19f9 for instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac on hv-cinder-76845 Nov 23 04:19:53.309747 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-a3edc147-2fda-4c91-b7d9-f8fbe8aa62b4 req-a1e5cd92-b7a2-4ae9-b605-5abf7868c1a5 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045573 Nov 23 04:19:53.311431 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 375/812] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:19:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:19:53.542177 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-40efc986-7958-44ca-b388-56a0e43030cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:53.542924 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-40efc986-7958-44ca-b388-56a0e43030cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:53.549608 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40efc986-7958-44ca-b388-56a0e43030cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:53.550349 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40efc986-7958-44ca-b388-56a0e43030cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:53.551531 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40efc986-7958-44ca-b388-56a0e43030cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:53.552153 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-40efc986-7958-44ca-b388-56a0e43030cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:53.650937 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-40efc986-7958-44ca-b388-56a0e43030cd tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 31812 microversion: 2.20 time: 0.114362 Nov 23 04:19:53.651609 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 438/813] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:53 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 31812 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:54.203753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:54.205061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:54.212443 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:54.213157 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:54.214471 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:54.215058 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:54.249934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:54.250375 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:54.251015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lazy-loading 'fault' on Instance uuid e7f1f74c-599b-40e5-aed9-cf063b9c46ac {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:19:54.330146 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a1d655b7be402c9339cfd5d09215f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc5d168617498bbafe5038567ca011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:19:54.339341 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-52057272-38ba-4a6d-b8d1-956e147df496 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 200 len: 1346 microversion: 2.1 time: 0.140174 Nov 23 04:19:54.339934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 376/814] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:54 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 1346 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:54.663428 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3e6a60d3-9718-43d5-afe9-7a8326223612 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:54.669479 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3e6a60d3-9718-43d5-afe9-7a8326223612 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:54.682578 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e6a60d3-9718-43d5-afe9-7a8326223612 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:54.682958 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e6a60d3-9718-43d5-afe9-7a8326223612 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:54.683872 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e6a60d3-9718-43d5-afe9-7a8326223612 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:54.684340 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e6a60d3-9718-43d5-afe9-7a8326223612 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:54.782427 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3e6a60d3-9718-43d5-afe9-7a8326223612 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 33154 microversion: 2.20 time: 0.123558 Nov 23 04:19:54.783097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 439/815] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:54 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 33154 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:19:55.361158 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f71e8d96-c5a0-42a5-b179-e2f7d6d23c7e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:55.361772 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f71e8d96-c5a0-42a5-b179-e2f7d6d23c7e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] [instance: e7f1f74c-599b-40e5-aed9-cf063b9c46ac] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:55.370686 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f71e8d96-c5a0-42a5-b179-e2f7d6d23c7e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:55.371134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f71e8d96-c5a0-42a5-b179-e2f7d6d23c7e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:55.372159 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f71e8d96-c5a0-42a5-b179-e2f7d6d23c7e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:55.372748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f71e8d96-c5a0-42a5-b179-e2f7d6d23c7e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:55.388353 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-f71e8d96-c5a0-42a5-b179-e2f7d6d23c7e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] HTTP exception thrown: Instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac could not be found. Nov 23 04:19:55.389248 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f71e8d96-c5a0-42a5-b179-e2f7d6d23c7e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Returning 404 to user: Instance e7f1f74c-599b-40e5-aed9-cf063b9c46ac could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:19:55.390073 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f71e8d96-c5a0-42a5-b179-e2f7d6d23c7e tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac" status: 404 len: 111 microversion: 2.1 time: 0.032725 Nov 23 04:19:55.390627 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 377/816] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:19:55 2021] GET /compute/v2.1/servers/e7f1f74c-599b-40e5-aed9-cf063b9c46ac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:19:55.400376 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-680b136c-efd6-444b-b6db-171e032e4f82 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] Calling method '.version_select at 0x7fa7dd78aee0>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:19:55.481481 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-680b136c-efd6-444b-b6db-171e032e4f82 tempest-TestMinimumBasicScenario-2087675834 tempest-TestMinimumBasicScenario-2087675834-project] 10.222.0.54 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-979248207" status: 202 len: 0 microversion: 2.1 time: 0.085914 Nov 23 04:19:55.485316 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 440/817] 10.222.0.54 () {58 vars in 1268 bytes} [Tue Nov 23 04:19:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-979248207 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:55.793991 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-21273f14-b5f0-40dc-b2a5-be326d05fe29 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:55.795050 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-21273f14-b5f0-40dc-b2a5-be326d05fe29 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:55.802040 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21273f14-b5f0-40dc-b2a5-be326d05fe29 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:55.802496 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21273f14-b5f0-40dc-b2a5-be326d05fe29 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:55.803884 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21273f14-b5f0-40dc-b2a5-be326d05fe29 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:55.811232 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21273f14-b5f0-40dc-b2a5-be326d05fe29 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:55.925337 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-21273f14-b5f0-40dc-b2a5-be326d05fe29 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 34141 microversion: 2.20 time: 0.134905 Nov 23 04:19:55.925992 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 378/818] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:55 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 34141 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:56.622944 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bd48dbb4-ead9-43b8-9568-b9a4543adeb3 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Action: 'create', calling method: .version_select at 0x7fa7dd78e4c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-303250207"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:56.637660 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-bd48dbb4-ead9-43b8-9568-b9a4543adeb3 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Getting quotas for project 29832a113f1544d7a5467a88b2f0d669. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:19:56.641282 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-bd48dbb4-ead9-43b8-9568-b9a4543adeb3 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Getting quotas for user 153a38363b5c4a2588ee3d43b8475342 and project 29832a113f1544d7a5467a88b2f0d669. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:19:56.939355 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4ae54da3-23ef-4417-a5a8-6c6adc0bf9e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:56.940719 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4ae54da3-23ef-4417-a5a8-6c6adc0bf9e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:56.950402 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ae54da3-23ef-4417-a5a8-6c6adc0bf9e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:56.950402 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ae54da3-23ef-4417-a5a8-6c6adc0bf9e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:56.950402 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ae54da3-23ef-4417-a5a8-6c6adc0bf9e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:56.950952 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ae54da3-23ef-4417-a5a8-6c6adc0bf9e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:57.019818 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-bd48dbb4-ead9-43b8-9568-b9a4543adeb3 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Getting quotas for project 29832a113f1544d7a5467a88b2f0d669. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:19:57.023724 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-bd48dbb4-ead9-43b8-9568-b9a4543adeb3 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Getting quotas for user 153a38363b5c4a2588ee3d43b8475342 and project 29832a113f1544d7a5467a88b2f0d669. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:19:57.036227 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bd48dbb4-ead9-43b8-9568-b9a4543adeb3 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.573648 Nov 23 04:19:57.037139 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 441/819] 10.222.0.54 () {60 vars in 1157 bytes} [Tue Nov 23 04:19:56 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:19:57.049249 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4ae54da3-23ef-4417-a5a8-6c6adc0bf9e5 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 35478 microversion: 2.20 time: 0.114317 Nov 23 04:19:57.049971 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 379/820] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:56 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 35478 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:58.062472 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f9f6d146-2727-4246-8a84-f4fde800dfbc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:58.063673 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f9f6d146-2727-4246-8a84-f4fde800dfbc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:58.070406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9f6d146-2727-4246-8a84-f4fde800dfbc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:58.071118 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9f6d146-2727-4246-8a84-f4fde800dfbc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:58.072137 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9f6d146-2727-4246-8a84-f4fde800dfbc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:58.072735 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9f6d146-2727-4246-8a84-f4fde800dfbc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:58.167487 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f9f6d146-2727-4246-8a84-f4fde800dfbc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 37014 microversion: 2.20 time: 0.109118 Nov 23 04:19:58.168660 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 442/821] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:58 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 37014 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:19:59.181151 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-64ce3519-efd5-4285-89a6-4dcc931dbb2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:19:59.182071 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-64ce3519-efd5-4285-89a6-4dcc931dbb2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:19:59.190787 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-64ce3519-efd5-4285-89a6-4dcc931dbb2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:59.191505 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-64ce3519-efd5-4285-89a6-4dcc931dbb2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:59.192865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-64ce3519-efd5-4285-89a6-4dcc931dbb2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:19:59.194821 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-64ce3519-efd5-4285-89a6-4dcc931dbb2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:19:59.321207 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-64ce3519-efd5-4285-89a6-4dcc931dbb2f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 38193 microversion: 2.20 time: 0.144915 Nov 23 04:19:59.322865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 380/822] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:19:59 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 38193 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:20:00.336127 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a1ef8f6f-2b22-427e-815b-7b1dfbab505d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:00.339101 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a1ef8f6f-2b22-427e-815b-7b1dfbab505d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:00.347861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1ef8f6f-2b22-427e-815b-7b1dfbab505d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:00.348404 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1ef8f6f-2b22-427e-815b-7b1dfbab505d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:00.349225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1ef8f6f-2b22-427e-815b-7b1dfbab505d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:00.349762 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1ef8f6f-2b22-427e-815b-7b1dfbab505d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:00.446664 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a1ef8f6f-2b22-427e-815b-7b1dfbab505d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 38193 microversion: 2.20 time: 0.116069 Nov 23 04:20:00.451713 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 443/823] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:20:00 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 38193 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:20:01.467286 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-54dda145-e017-40c4-8f41-ea69b81456b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:01.474769 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-54dda145-e017-40c4-8f41-ea69b81456b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:01.491108 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-54dda145-e017-40c4-8f41-ea69b81456b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:01.492059 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-54dda145-e017-40c4-8f41-ea69b81456b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:01.493058 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-54dda145-e017-40c4-8f41-ea69b81456b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:01.493506 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-54dda145-e017-40c4-8f41-ea69b81456b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:01.589903 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-54dda145-e017-40c4-8f41-ea69b81456b4 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 38193 microversion: 2.20 time: 0.134033 Nov 23 04:20:01.590787 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 381/824] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:20:01 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 38193 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:20:02.603699 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-cae61ca0-6c75-4c0e-8a4e-fe705daea493 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:02.604616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-cae61ca0-6c75-4c0e-8a4e-fe705daea493 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:02.612125 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cae61ca0-6c75-4c0e-8a4e-fe705daea493 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:02.613189 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cae61ca0-6c75-4c0e-8a4e-fe705daea493 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:02.614220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cae61ca0-6c75-4c0e-8a4e-fe705daea493 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:02.614868 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cae61ca0-6c75-4c0e-8a4e-fe705daea493 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:02.706678 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-cae61ca0-6c75-4c0e-8a4e-fe705daea493 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 38193 microversion: 2.20 time: 0.107554 Nov 23 04:20:02.707376 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 444/825] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:20:02 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 38193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:20:03.721265 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-274a89cc-82cf-4a1b-b6dd-e53ac369af11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:03.722749 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-274a89cc-82cf-4a1b-b6dd-e53ac369af11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:03.730256 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-274a89cc-82cf-4a1b-b6dd-e53ac369af11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:03.730708 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-274a89cc-82cf-4a1b-b6dd-e53ac369af11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:03.731574 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-274a89cc-82cf-4a1b-b6dd-e53ac369af11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:03.732102 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-274a89cc-82cf-4a1b-b6dd-e53ac369af11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:03.848723 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-274a89cc-82cf-4a1b-b6dd-e53ac369af11 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 200 len: 38336 microversion: 2.20 time: 0.132383 Nov 23 04:20:03.849663 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 382/826] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:20:03 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 38336 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:20:03.860788 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7d86234b-359d-45a6-a1f4-473491406396 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:03.861355 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7d86234b-359d-45a6-a1f4-473491406396 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:03.869510 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7d86234b-359d-45a6-a1f4-473491406396 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:03.871275 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7d86234b-359d-45a6-a1f4-473491406396 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:03.872726 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7d86234b-359d-45a6-a1f4-473491406396 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:03.873705 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7d86234b-359d-45a6-a1f4-473491406396 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:03.902057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7d86234b-359d-45a6-a1f4-473491406396 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/ips" status: 200 len: 151 microversion: 2.20 time: 0.045394 Nov 23 04:20:03.902769 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 445/827] 10.222.0.54 () {60 vars in 1288 bytes} [Tue Nov 23 04:20:03 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:20:06.305642 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-df5893ac-7407-4e4a-9e89-92231b1263a7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:06.306267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-df5893ac-7407-4e4a-9e89-92231b1263a7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:06.313115 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-df5893ac-7407-4e4a-9e89-92231b1263a7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:06.313566 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-df5893ac-7407-4e4a-9e89-92231b1263a7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:06.314346 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-df5893ac-7407-4e4a-9e89-92231b1263a7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:06.314785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-df5893ac-7407-4e4a-9e89-92231b1263a7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:06.341374 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-df5893ac-7407-4e4a-9e89-92231b1263a7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lazy-loading 'flavor' on Instance uuid a2542af4-c4d5-4fc0-b86c-00df6da8fd61 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:20:07.117934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-df5893ac-7407-4e4a-9e89-92231b1263a7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 202 len: 0 microversion: 2.20 time: 0.816669 Nov 23 04:20:07.118574 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 383/828] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:20:06 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:20:07.128152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2d330d11-8ed0-498c-8757-665957f27205 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:07.128819 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2d330d11-8ed0-498c-8757-665957f27205 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:07.136819 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d330d11-8ed0-498c-8757-665957f27205 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:07.137256 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d330d11-8ed0-498c-8757-665957f27205 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:07.138036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d330d11-8ed0-498c-8757-665957f27205 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:07.138580 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d330d11-8ed0-498c-8757-665957f27205 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:07.309833 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2d330d11-8ed0-498c-8757-665957f27205 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:07.317857 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2d330d11-8ed0-498c-8757-665957f27205 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:07.319981 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2d330d11-8ed0-498c-8757-665957f27205 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:07.321150 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2d330d11-8ed0-498c-8757-665957f27205 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.196724 Nov 23 04:20:07.321705 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 446/829] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:07 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:20:08.342108 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-15de9325-ee68-4814-ad42-afddad59f792 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:08.342802 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-15de9325-ee68-4814-ad42-afddad59f792 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:08.349072 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15de9325-ee68-4814-ad42-afddad59f792 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:08.350750 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15de9325-ee68-4814-ad42-afddad59f792 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:08.351612 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15de9325-ee68-4814-ad42-afddad59f792 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:08.352054 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15de9325-ee68-4814-ad42-afddad59f792 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:08.491916 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-15de9325-ee68-4814-ad42-afddad59f792 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:08.500372 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-15de9325-ee68-4814-ad42-afddad59f792 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:08.501877 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-15de9325-ee68-4814-ad42-afddad59f792 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:08.503041 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-15de9325-ee68-4814-ad42-afddad59f792 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.165655 Nov 23 04:20:08.503643 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 384/830] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:08 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:09.521870 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-708e5c8d-8322-428b-b7de-663c19f3cf40 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:09.522482 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-708e5c8d-8322-428b-b7de-663c19f3cf40 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:09.529086 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-708e5c8d-8322-428b-b7de-663c19f3cf40 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:09.529534 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-708e5c8d-8322-428b-b7de-663c19f3cf40 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:09.530317 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-708e5c8d-8322-428b-b7de-663c19f3cf40 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:09.530751 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-708e5c8d-8322-428b-b7de-663c19f3cf40 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:09.726615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-708e5c8d-8322-428b-b7de-663c19f3cf40 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:09.734554 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-708e5c8d-8322-428b-b7de-663c19f3cf40 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:09.736057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-708e5c8d-8322-428b-b7de-663c19f3cf40 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:09.738138 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-708e5c8d-8322-428b-b7de-663c19f3cf40 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.219132 Nov 23 04:20:09.738138 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 447/831] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:09 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:10.762047 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-636d9f1e-408c-4bff-9f60-49620d56c814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:10.762047 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-636d9f1e-408c-4bff-9f60-49620d56c814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:10.764675 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-636d9f1e-408c-4bff-9f60-49620d56c814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:10.765127 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-636d9f1e-408c-4bff-9f60-49620d56c814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:10.766123 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-636d9f1e-408c-4bff-9f60-49620d56c814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:10.766565 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-636d9f1e-408c-4bff-9f60-49620d56c814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:11.009128 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-636d9f1e-408c-4bff-9f60-49620d56c814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:11.017389 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-636d9f1e-408c-4bff-9f60-49620d56c814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:11.018884 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-636d9f1e-408c-4bff-9f60-49620d56c814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:11.020098 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-636d9f1e-408c-4bff-9f60-49620d56c814 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.268110 Nov 23 04:20:11.020650 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 385/832] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:10 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:12.038435 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a04558ad-e992-4744-abd6-c094f1039134 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:12.039048 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a04558ad-e992-4744-abd6-c094f1039134 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:12.047343 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a04558ad-e992-4744-abd6-c094f1039134 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:12.048129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a04558ad-e992-4744-abd6-c094f1039134 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:12.049094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a04558ad-e992-4744-abd6-c094f1039134 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:12.049527 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a04558ad-e992-4744-abd6-c094f1039134 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:12.221627 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a04558ad-e992-4744-abd6-c094f1039134 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:12.234643 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a04558ad-e992-4744-abd6-c094f1039134 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:12.237388 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a04558ad-e992-4744-abd6-c094f1039134 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:12.238824 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a04558ad-e992-4744-abd6-c094f1039134 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.204653 Nov 23 04:20:12.239653 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 448/833] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:12 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:13.257913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-39d3b8a4-b966-4034-9486-4fec928f4bb6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:13.259170 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-39d3b8a4-b966-4034-9486-4fec928f4bb6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:13.266482 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-39d3b8a4-b966-4034-9486-4fec928f4bb6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:13.270205 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-39d3b8a4-b966-4034-9486-4fec928f4bb6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:13.274758 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-39d3b8a4-b966-4034-9486-4fec928f4bb6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:13.275451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-39d3b8a4-b966-4034-9486-4fec928f4bb6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:13.458803 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-39d3b8a4-b966-4034-9486-4fec928f4bb6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:13.468122 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-39d3b8a4-b966-4034-9486-4fec928f4bb6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:13.472682 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-39d3b8a4-b966-4034-9486-4fec928f4bb6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:13.472682 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-39d3b8a4-b966-4034-9486-4fec928f4bb6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.217298 Nov 23 04:20:13.472682 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 386/834] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:13 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:14.493654 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2cbb1a60-95f7-44c4-a0bd-da480157287d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:14.494227 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2cbb1a60-95f7-44c4-a0bd-da480157287d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:14.500227 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cbb1a60-95f7-44c4-a0bd-da480157287d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:14.500771 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cbb1a60-95f7-44c4-a0bd-da480157287d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:14.501762 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cbb1a60-95f7-44c4-a0bd-da480157287d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:14.502188 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2cbb1a60-95f7-44c4-a0bd-da480157287d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:14.635135 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2cbb1a60-95f7-44c4-a0bd-da480157287d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:14.643045 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2cbb1a60-95f7-44c4-a0bd-da480157287d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:14.644525 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2cbb1a60-95f7-44c4-a0bd-da480157287d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:14.645687 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2cbb1a60-95f7-44c4-a0bd-da480157287d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.159621 Nov 23 04:20:14.655312 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 449/835] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:14 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:15.667273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9a9fa13b-1092-4326-b1e3-9e4648148161 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:15.668478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9a9fa13b-1092-4326-b1e3-9e4648148161 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:15.674665 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9a9fa13b-1092-4326-b1e3-9e4648148161 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:15.675584 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9a9fa13b-1092-4326-b1e3-9e4648148161 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:15.676556 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9a9fa13b-1092-4326-b1e3-9e4648148161 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:15.677028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9a9fa13b-1092-4326-b1e3-9e4648148161 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:15.852045 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9a9fa13b-1092-4326-b1e3-9e4648148161 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:15.864241 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9a9fa13b-1092-4326-b1e3-9e4648148161 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:15.871909 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9a9fa13b-1092-4326-b1e3-9e4648148161 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:15.873144 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9a9fa13b-1092-4326-b1e3-9e4648148161 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.210150 Nov 23 04:20:15.873707 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 387/836] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:15 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:16.891596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3a789b91-0d12-4869-8aaa-1dfbec46b658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:16.892219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3a789b91-0d12-4869-8aaa-1dfbec46b658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:16.901484 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3a789b91-0d12-4869-8aaa-1dfbec46b658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:16.901679 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3a789b91-0d12-4869-8aaa-1dfbec46b658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:16.906246 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3a789b91-0d12-4869-8aaa-1dfbec46b658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:16.906246 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3a789b91-0d12-4869-8aaa-1dfbec46b658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:17.217475 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3a789b91-0d12-4869-8aaa-1dfbec46b658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:17.233185 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3a789b91-0d12-4869-8aaa-1dfbec46b658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:17.234866 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3a789b91-0d12-4869-8aaa-1dfbec46b658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:17.238998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3a789b91-0d12-4869-8aaa-1dfbec46b658 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.349423 Nov 23 04:20:17.252800 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 450/837] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:16 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:20:18.262173 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-60956349-6ded-4031-a72b-6409e9c51155 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:18.262783 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-60956349-6ded-4031-a72b-6409e9c51155 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:18.269707 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60956349-6ded-4031-a72b-6409e9c51155 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:18.270340 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60956349-6ded-4031-a72b-6409e9c51155 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:18.271546 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60956349-6ded-4031-a72b-6409e9c51155 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:18.272073 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60956349-6ded-4031-a72b-6409e9c51155 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:18.538940 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-60956349-6ded-4031-a72b-6409e9c51155 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:18.554371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-60956349-6ded-4031-a72b-6409e9c51155 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:18.556918 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-60956349-6ded-4031-a72b-6409e9c51155 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:18.558761 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-60956349-6ded-4031-a72b-6409e9c51155 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1745 microversion: 2.20 time: 0.300267 Nov 23 04:20:18.560808 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 388/838] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:18 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1745 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:19.239319 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-515039292", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-303250207", "security_groups": [{"name": "tempest-secgroup-smoke-562528270"}], "networks": [{"uuid": "e3530e0d-07ae-4ff9-b495-05515e155951"}], "block_device_mapping_v2": [{"uuid": "eeeb8b07-a96b-4e03-a252-dfecf5c6de28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:19.384229 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] validate_networks() for [('e3530e0d-07ae-4ff9-b495-05515e155951', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:20:19.577825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-80daf596-4a03-4744-8398-aed06f82f626 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:19.579184 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-80daf596-4a03-4744-8398-aed06f82f626 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:19.586945 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-80daf596-4a03-4744-8398-aed06f82f626 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:19.587787 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-80daf596-4a03-4744-8398-aed06f82f626 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:19.589195 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-80daf596-4a03-4744-8398-aed06f82f626 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:19.589900 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-80daf596-4a03-4744-8398-aed06f82f626 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:19.763606 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-80daf596-4a03-4744-8398-aed06f82f626 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:19.777794 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-80daf596-4a03-4744-8398-aed06f82f626 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:19.781547 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-80daf596-4a03-4744-8398-aed06f82f626 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:19.782979 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-80daf596-4a03-4744-8398-aed06f82f626 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1745 microversion: 2.20 time: 0.208865 Nov 23 04:20:19.796492 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 389/839] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:19 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:20:20.068269 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:20:20.069006 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:20:20.069547 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:20:20.069958 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:20:20.070372 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:20:20.092929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:20.093391 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:20.094213 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:20.094650 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:20.119323 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Getting quotas for project 29832a113f1544d7a5467a88b2f0d669. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:20:20.137056 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Getting quotas for user 153a38363b5c4a2588ee3d43b8475342 and project 29832a113f1544d7a5467a88b2f0d669. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:20:20.225852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:20:20.228345 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eeeb8b07-a96b-4e03-a252-dfecf5c6de28',volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:20:20.790454 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d9b883e5-e26a-4d6a-9da1-a4f00e419f0b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.554467 Nov 23 04:20:20.797821 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 451/840] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:20:19 2021] POST /compute/v2.1/servers => generated 405 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:20:20.801620 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a30711b5-2913-4deb-886a-6436b2f7ed35 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:20.802268 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a30711b5-2913-4deb-886a-6436b2f7ed35 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:20.834828 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-190a9850-af38-475e-b714-d797dfea7c42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:20.835586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-190a9850-af38-475e-b714-d797dfea7c42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:20.850390 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-190a9850-af38-475e-b714-d797dfea7c42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:20.853917 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-190a9850-af38-475e-b714-d797dfea7c42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:20.855191 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-190a9850-af38-475e-b714-d797dfea7c42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:20.857659 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-190a9850-af38-475e-b714-d797dfea7c42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:20.873373 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a30711b5-2913-4deb-886a-6436b2f7ed35 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:20.882910 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a30711b5-2913-4deb-886a-6436b2f7ed35 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1087 microversion: 2.1 time: 0.084921 Nov 23 04:20:20.902051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 390/841] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:20 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1087 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:20:21.078350 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-190a9850-af38-475e-b714-d797dfea7c42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:21.092177 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-190a9850-af38-475e-b714-d797dfea7c42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:21.094983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-190a9850-af38-475e-b714-d797dfea7c42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:21.100740 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-190a9850-af38-475e-b714-d797dfea7c42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.301538 Nov 23 04:20:21.101666 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 452/842] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:20 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:21.663656 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ca0073b0-82bc-4c4b-97f4-0b1e2afb62e0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Action: 'create', calling method: .version_select at 0x7fa7ddf8a4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-673532001"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:21.691834 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-ca0073b0-82bc-4c4b-97f4-0b1e2afb62e0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Getting quotas for project 8068470657b040ab9af34219d8935846. Resources: {'key_pairs'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:20:21.699800 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-ca0073b0-82bc-4c4b-97f4-0b1e2afb62e0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Getting quotas for user 97e3605d1b0045e48d5836380ce77dc6 and project 8068470657b040ab9af34219d8935846. Resources: {'key_pairs'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:20:21.901182 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-678598a8-f57c-4d3b-9cda-04f94fbc9c52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:21.902470 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-678598a8-f57c-4d3b-9cda-04f94fbc9c52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:21.993383 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-678598a8-f57c-4d3b-9cda-04f94fbc9c52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:22.005550 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-678598a8-f57c-4d3b-9cda-04f94fbc9c52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1087 microversion: 2.1 time: 0.103147 Nov 23 04:20:22.005550 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 453/843] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:21 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1087 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:22.082478 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-ca0073b0-82bc-4c4b-97f4-0b1e2afb62e0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Getting quotas for project 8068470657b040ab9af34219d8935846. Resources: {'key_pairs'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:20:22.089489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-ca0073b0-82bc-4c4b-97f4-0b1e2afb62e0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Getting quotas for user 97e3605d1b0045e48d5836380ce77dc6 and project 8068470657b040ab9af34219d8935846. Resources: {'key_pairs'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:20:22.105876 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ca0073b0-82bc-4c4b-97f4-0b1e2afb62e0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.661823 Nov 23 04:20:22.107464 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 391/844] 10.222.0.54 () {60 vars in 1157 bytes} [Tue Nov 23 04:20:21 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:20:22.123097 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9c72e21b-8c09-4a27-a8a2-d59d991a3350 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:22.123743 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9c72e21b-8c09-4a27-a8a2-d59d991a3350 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:22.150725 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9c72e21b-8c09-4a27-a8a2-d59d991a3350 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:22.161517 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9c72e21b-8c09-4a27-a8a2-d59d991a3350 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:22.162589 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9c72e21b-8c09-4a27-a8a2-d59d991a3350 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:22.164736 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9c72e21b-8c09-4a27-a8a2-d59d991a3350 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:22.279060 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-186ccd6e-e626-419d-a13d-156400780086 req-7969b7a7-fc5e-4239-b808-b8bfde840bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2542af4-c4d5-4fc0-b86c-00df6da8fd61", "name": "network-vif-plugged", "status": "completed", "tag": "ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:22.295499 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:20:22.295499 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:20:22.313450 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-186ccd6e-e626-419d-a13d-156400780086 req-7969b7a7-fc5e-4239-b808-b8bfde840bfc service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:22.314005 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-186ccd6e-e626-419d-a13d-156400780086 req-7969b7a7-fc5e-4239-b808-b8bfde840bfc service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:22.347805 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-186ccd6e-e626-419d-a13d-156400780086 req-7969b7a7-fc5e-4239-b808-b8bfde840bfc service nova] Creating event network-vif-plugged:ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673 for instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 on hv-cinder-76845 Nov 23 04:20:22.367717 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-186ccd6e-e626-419d-a13d-156400780086 req-7969b7a7-fc5e-4239-b808-b8bfde840bfc service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253005 Nov 23 04:20:22.371852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 454/845] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:20:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:20:22.446515 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9c72e21b-8c09-4a27-a8a2-d59d991a3350 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:22.458984 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9c72e21b-8c09-4a27-a8a2-d59d991a3350 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:22.462616 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9c72e21b-8c09-4a27-a8a2-d59d991a3350 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:22.463984 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9c72e21b-8c09-4a27-a8a2-d59d991a3350 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.344883 Nov 23 04:20:22.464554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 392/846] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:22 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:20:23.017889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d863624c-765d-4cab-bf74-2ebccae11e70 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:23.018583 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d863624c-765d-4cab-bf74-2ebccae11e70 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:23.081782 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d863624c-765d-4cab-bf74-2ebccae11e70 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:23.097852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d863624c-765d-4cab-bf74-2ebccae11e70 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1087 microversion: 2.1 time: 0.083861 Nov 23 04:20:23.098635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 455/847] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:23 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1087 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:23.481649 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fd122068-2440-491e-a6b7-e5f490fa90c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:23.486564 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fd122068-2440-491e-a6b7-e5f490fa90c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:23.490541 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd122068-2440-491e-a6b7-e5f490fa90c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:23.491279 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd122068-2440-491e-a6b7-e5f490fa90c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:23.492234 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd122068-2440-491e-a6b7-e5f490fa90c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:23.492868 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd122068-2440-491e-a6b7-e5f490fa90c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:23.660549 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fd122068-2440-491e-a6b7-e5f490fa90c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:23.676086 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fd122068-2440-491e-a6b7-e5f490fa90c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:23.677579 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fd122068-2440-491e-a6b7-e5f490fa90c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:23.679402 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fd122068-2440-491e-a6b7-e5f490fa90c6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.201384 Nov 23 04:20:23.691960 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 393/848] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:23 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:24.120103 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5619216a-2ccb-4ee7-a889-f3ab6be4f2a8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:24.121162 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5619216a-2ccb-4ee7-a889-f3ab6be4f2a8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:24.216424 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5619216a-2ccb-4ee7-a889-f3ab6be4f2a8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:24.225286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5619216a-2ccb-4ee7-a889-f3ab6be4f2a8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1087 microversion: 2.1 time: 0.112124 Nov 23 04:20:24.225747 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 456/849] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:24 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1087 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:24.699314 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-dabb5bb8-bc18-4b45-92ca-061484767a5f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:24.700023 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-dabb5bb8-bc18-4b45-92ca-061484767a5f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:24.707383 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dabb5bb8-bc18-4b45-92ca-061484767a5f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:24.707914 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dabb5bb8-bc18-4b45-92ca-061484767a5f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:24.708837 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dabb5bb8-bc18-4b45-92ca-061484767a5f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:24.709272 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dabb5bb8-bc18-4b45-92ca-061484767a5f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:24.962351 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-dabb5bb8-bc18-4b45-92ca-061484767a5f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:24.972393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-dabb5bb8-bc18-4b45-92ca-061484767a5f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:24.975132 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-dabb5bb8-bc18-4b45-92ca-061484767a5f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:24.981227 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-dabb5bb8-bc18-4b45-92ca-061484767a5f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.280813 Nov 23 04:20:24.981227 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 394/850] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:24 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:25.242194 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-65fca89d-101a-4606-804c-77d651953f12 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:25.243441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-65fca89d-101a-4606-804c-77d651953f12 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:25.341796 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-65fca89d-101a-4606-804c-77d651953f12 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:25.353818 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-65fca89d-101a-4606-804c-77d651953f12 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1087 microversion: 2.1 time: 0.115350 Nov 23 04:20:25.356438 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 457/851] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:25 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1087 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:25.995505 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f0fd4008-999a-449a-b1fc-a14937329dc2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:25.996258 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f0fd4008-999a-449a-b1fc-a14937329dc2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:26.012360 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f0fd4008-999a-449a-b1fc-a14937329dc2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:26.013258 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f0fd4008-999a-449a-b1fc-a14937329dc2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:26.014433 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f0fd4008-999a-449a-b1fc-a14937329dc2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:26.015087 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f0fd4008-999a-449a-b1fc-a14937329dc2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:26.338642 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f0fd4008-999a-449a-b1fc-a14937329dc2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:26.350985 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f0fd4008-999a-449a-b1fc-a14937329dc2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:26.352840 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f0fd4008-999a-449a-b1fc-a14937329dc2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:26.354213 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f0fd4008-999a-449a-b1fc-a14937329dc2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.363363 Nov 23 04:20:26.354967 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 395/852] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:25 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:26.380489 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2c925ffb-89b2-430c-979c-c5d3486853f8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:26.382913 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2c925ffb-89b2-430c-979c-c5d3486853f8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:26.404688 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2c925ffb-89b2-430c-979c-c5d3486853f8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:26.407331 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2c925ffb-89b2-430c-979c-c5d3486853f8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:26.408354 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2c925ffb-89b2-430c-979c-c5d3486853f8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:26.409120 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2c925ffb-89b2-430c-979c-c5d3486853f8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:26.491986 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2c925ffb-89b2-430c-979c-c5d3486853f8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:26.500889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2c925ffb-89b2-430c-979c-c5d3486853f8 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1137 microversion: 2.1 time: 0.131787 Nov 23 04:20:26.501472 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 458/853] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:26 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1137 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:27.374965 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bfd0afae-06e1-496c-a0ac-b6b546f9c7d6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:27.376100 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-bfd0afae-06e1-496c-a0ac-b6b546f9c7d6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:27.384542 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bfd0afae-06e1-496c-a0ac-b6b546f9c7d6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:27.385000 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bfd0afae-06e1-496c-a0ac-b6b546f9c7d6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:27.385924 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bfd0afae-06e1-496c-a0ac-b6b546f9c7d6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:27.386269 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bfd0afae-06e1-496c-a0ac-b6b546f9c7d6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:27.519127 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6024df5e-9aca-4914-b928-d7a03012e7cd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:27.519769 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6024df5e-9aca-4914-b928-d7a03012e7cd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:27.556594 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6024df5e-9aca-4914-b928-d7a03012e7cd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:27.558581 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6024df5e-9aca-4914-b928-d7a03012e7cd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:27.559450 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6024df5e-9aca-4914-b928-d7a03012e7cd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:27.563227 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6024df5e-9aca-4914-b928-d7a03012e7cd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:27.626553 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bfd0afae-06e1-496c-a0ac-b6b546f9c7d6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:27.642817 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bfd0afae-06e1-496c-a0ac-b6b546f9c7d6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:27.648402 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bfd0afae-06e1-496c-a0ac-b6b546f9c7d6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:27.653050 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bfd0afae-06e1-496c-a0ac-b6b546f9c7d6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.281604 Nov 23 04:20:27.655745 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 396/854] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:27 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:27.676891 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6024df5e-9aca-4914-b928-d7a03012e7cd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:27.686706 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6024df5e-9aca-4914-b928-d7a03012e7cd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1129 microversion: 2.1 time: 0.171644 Nov 23 04:20:27.688942 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 459/855] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:27 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1129 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:20:28.674581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-24cb9136-3859-4f33-9daa-31342e19a68c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:28.678014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-24cb9136-3859-4f33-9daa-31342e19a68c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:28.684076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-24cb9136-3859-4f33-9daa-31342e19a68c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:28.684520 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-24cb9136-3859-4f33-9daa-31342e19a68c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:28.685364 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-24cb9136-3859-4f33-9daa-31342e19a68c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:28.685804 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-24cb9136-3859-4f33-9daa-31342e19a68c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:28.705883 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c6964fb6-a338-4301-8de8-11cbcfd8f191 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:28.708336 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c6964fb6-a338-4301-8de8-11cbcfd8f191 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:28.715381 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c6964fb6-a338-4301-8de8-11cbcfd8f191 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:28.716060 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c6964fb6-a338-4301-8de8-11cbcfd8f191 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:28.717043 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c6964fb6-a338-4301-8de8-11cbcfd8f191 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:28.717638 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c6964fb6-a338-4301-8de8-11cbcfd8f191 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:28.827591 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c6964fb6-a338-4301-8de8-11cbcfd8f191 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:28.835301 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c6964fb6-a338-4301-8de8-11cbcfd8f191 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1193 microversion: 2.1 time: 0.133105 Nov 23 04:20:28.836098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 460/856] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:28 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1193 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:29.016915 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-24cb9136-3859-4f33-9daa-31342e19a68c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:29.016915 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-24cb9136-3859-4f33-9daa-31342e19a68c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:29.017134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-24cb9136-3859-4f33-9daa-31342e19a68c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:29.017134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-24cb9136-3859-4f33-9daa-31342e19a68c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.284948 Nov 23 04:20:29.017134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 397/857] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:28 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:29.854017 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-73ae4173-c34a-4104-9743-a1ca90a47ff1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:29.855148 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-73ae4173-c34a-4104-9743-a1ca90a47ff1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:29.863696 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-73ae4173-c34a-4104-9743-a1ca90a47ff1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:29.864506 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-73ae4173-c34a-4104-9743-a1ca90a47ff1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:29.865518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-73ae4173-c34a-4104-9743-a1ca90a47ff1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:29.866199 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-73ae4173-c34a-4104-9743-a1ca90a47ff1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:29.939825 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-73ae4173-c34a-4104-9743-a1ca90a47ff1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:29.948681 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-73ae4173-c34a-4104-9743-a1ca90a47ff1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1203 microversion: 2.1 time: 0.099970 Nov 23 04:20:29.949549 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 461/858] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:29 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1203 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:30.033966 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3eb1b415-9578-45b8-91e9-96a4df7533c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:30.034554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3eb1b415-9578-45b8-91e9-96a4df7533c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:30.047279 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3eb1b415-9578-45b8-91e9-96a4df7533c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:30.047279 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3eb1b415-9578-45b8-91e9-96a4df7533c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:30.048040 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3eb1b415-9578-45b8-91e9-96a4df7533c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:30.048501 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3eb1b415-9578-45b8-91e9-96a4df7533c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:30.258056 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3eb1b415-9578-45b8-91e9-96a4df7533c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:30.273066 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3eb1b415-9578-45b8-91e9-96a4df7533c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:30.278860 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3eb1b415-9578-45b8-91e9-96a4df7533c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:30.281483 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3eb1b415-9578-45b8-91e9-96a4df7533c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.251598 Nov 23 04:20:30.282096 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 398/859] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:30 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:30.968134 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-aa6f597c-ef9a-4d54-9b9d-1e1c3285f724 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:30.970353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-aa6f597c-ef9a-4d54-9b9d-1e1c3285f724 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:30.979035 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aa6f597c-ef9a-4d54-9b9d-1e1c3285f724 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:30.979892 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aa6f597c-ef9a-4d54-9b9d-1e1c3285f724 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:30.981129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aa6f597c-ef9a-4d54-9b9d-1e1c3285f724 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:30.981865 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-aa6f597c-ef9a-4d54-9b9d-1e1c3285f724 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:31.263690 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-aa6f597c-ef9a-4d54-9b9d-1e1c3285f724 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:31.273812 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-aa6f597c-ef9a-4d54-9b9d-1e1c3285f724 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.310124 Nov 23 04:20:31.284947 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 462/860] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:30 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:31.301958 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-91de794b-6585-4c1b-8a2e-b6273d1a753a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:31.303315 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-91de794b-6585-4c1b-8a2e-b6273d1a753a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:31.309801 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-91de794b-6585-4c1b-8a2e-b6273d1a753a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:31.310460 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-91de794b-6585-4c1b-8a2e-b6273d1a753a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:31.311425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-91de794b-6585-4c1b-8a2e-b6273d1a753a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:31.312027 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-91de794b-6585-4c1b-8a2e-b6273d1a753a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:31.453826 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-611ec2ee-f130-4ba3-9774-fd15d2d9e1e3 req-d04b2ffe-d193-4401-a3e6-331347648f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe99c22a-d75b-4a5c-8800-6a65d64ded71", "tag": "6785c855-b933-47d9-95d0-982e7c07f503"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:31.456739 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:20:31.456739 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:20:31.479132 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-611ec2ee-f130-4ba3-9774-fd15d2d9e1e3 req-d04b2ffe-d193-4401-a3e6-331347648f07 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:31.480160 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-611ec2ee-f130-4ba3-9774-fd15d2d9e1e3 req-d04b2ffe-d193-4401-a3e6-331347648f07 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:31.511196 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-611ec2ee-f130-4ba3-9774-fd15d2d9e1e3 req-d04b2ffe-d193-4401-a3e6-331347648f07 service nova] Creating event network-changed:6785c855-b933-47d9-95d0-982e7c07f503 for instance fe99c22a-d75b-4a5c-8800-6a65d64ded71 on hv-cinder-76845 Nov 23 04:20:31.526381 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-611ec2ee-f130-4ba3-9774-fd15d2d9e1e3 req-d04b2ffe-d193-4401-a3e6-331347648f07 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076656 Nov 23 04:20:31.527261 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 463/861] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:20:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:20:31.650284 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-91de794b-6585-4c1b-8a2e-b6273d1a753a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:31.663682 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-91de794b-6585-4c1b-8a2e-b6273d1a753a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:31.665348 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-91de794b-6585-4c1b-8a2e-b6273d1a753a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:31.668039 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-91de794b-6585-4c1b-8a2e-b6273d1a753a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.369965 Nov 23 04:20:31.685107 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 399/862] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:31 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:20:32.294713 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-835928fe-d60e-4ec6-9984-3b1cb460e7d5 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:32.295554 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-835928fe-d60e-4ec6-9984-3b1cb460e7d5 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:32.302821 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-835928fe-d60e-4ec6-9984-3b1cb460e7d5 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:32.303410 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-835928fe-d60e-4ec6-9984-3b1cb460e7d5 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:32.304294 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-835928fe-d60e-4ec6-9984-3b1cb460e7d5 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:32.304803 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-835928fe-d60e-4ec6-9984-3b1cb460e7d5 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:32.535770 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-835928fe-d60e-4ec6-9984-3b1cb460e7d5 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:32.545074 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-835928fe-d60e-4ec6-9984-3b1cb460e7d5 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.255698 Nov 23 04:20:32.546280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 464/863] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:32 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:32.691635 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-75e27918-ab21-4730-b915-a569808be525 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:32.692293 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-75e27918-ab21-4730-b915-a569808be525 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:32.698765 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-75e27918-ab21-4730-b915-a569808be525 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:32.699235 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-75e27918-ab21-4730-b915-a569808be525 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:32.700001 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-75e27918-ab21-4730-b915-a569808be525 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:32.700438 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-75e27918-ab21-4730-b915-a569808be525 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:32.841123 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-75e27918-ab21-4730-b915-a569808be525 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:32.849804 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-75e27918-ab21-4730-b915-a569808be525 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:32.851299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-75e27918-ab21-4730-b915-a569808be525 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:32.852516 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-75e27918-ab21-4730-b915-a569808be525 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.164586 Nov 23 04:20:32.853076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 400/864] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:32 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:33.564903 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8b932121-f166-4e0b-aa71-0b484f07872b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:33.565730 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8b932121-f166-4e0b-aa71-0b484f07872b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:33.573286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b932121-f166-4e0b-aa71-0b484f07872b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:33.573836 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b932121-f166-4e0b-aa71-0b484f07872b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:33.574905 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b932121-f166-4e0b-aa71-0b484f07872b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:33.575432 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8b932121-f166-4e0b-aa71-0b484f07872b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:33.723025 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-8b932121-f166-4e0b-aa71-0b484f07872b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:33.735610 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8b932121-f166-4e0b-aa71-0b484f07872b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.173893 Nov 23 04:20:33.736771 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 465/865] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:33 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:33.871162 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-07174b1f-2da6-4ff1-bbc8-54ed3484eeba tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:33.871775 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-07174b1f-2da6-4ff1-bbc8-54ed3484eeba tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:33.878095 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-07174b1f-2da6-4ff1-bbc8-54ed3484eeba tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:33.878549 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-07174b1f-2da6-4ff1-bbc8-54ed3484eeba tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:33.879367 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-07174b1f-2da6-4ff1-bbc8-54ed3484eeba tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:33.881121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-07174b1f-2da6-4ff1-bbc8-54ed3484eeba tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:34.021322 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-07174b1f-2da6-4ff1-bbc8-54ed3484eeba tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:34.028993 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-07174b1f-2da6-4ff1-bbc8-54ed3484eeba tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:34.030465 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-07174b1f-2da6-4ff1-bbc8-54ed3484eeba tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:34.031647 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-07174b1f-2da6-4ff1-bbc8-54ed3484eeba tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1740 microversion: 2.20 time: 0.164294 Nov 23 04:20:34.032202 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 401/866] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:33 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:34.752239 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-860b32f6-afb0-440e-b2b5-5ab81010c2cb tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:34.752839 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-860b32f6-afb0-440e-b2b5-5ab81010c2cb tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:34.759260 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-860b32f6-afb0-440e-b2b5-5ab81010c2cb tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:34.759716 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-860b32f6-afb0-440e-b2b5-5ab81010c2cb tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:34.760563 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-860b32f6-afb0-440e-b2b5-5ab81010c2cb tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:34.760995 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-860b32f6-afb0-440e-b2b5-5ab81010c2cb tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:34.901537 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-860b32f6-afb0-440e-b2b5-5ab81010c2cb tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:34.908921 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-860b32f6-afb0-440e-b2b5-5ab81010c2cb tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.160297 Nov 23 04:20:34.909476 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 466/867] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:34 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:35.049970 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ed2a9fd0-de98-4dd3-9d6c-6ea86f3bfed6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:35.050733 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ed2a9fd0-de98-4dd3-9d6c-6ea86f3bfed6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:35.057129 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ed2a9fd0-de98-4dd3-9d6c-6ea86f3bfed6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:35.057579 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ed2a9fd0-de98-4dd3-9d6c-6ea86f3bfed6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:35.058360 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ed2a9fd0-de98-4dd3-9d6c-6ea86f3bfed6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:35.058790 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ed2a9fd0-de98-4dd3-9d6c-6ea86f3bfed6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:35.286807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ed2a9fd0-de98-4dd3-9d6c-6ea86f3bfed6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:35.294402 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ed2a9fd0-de98-4dd3-9d6c-6ea86f3bfed6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:35.295920 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ed2a9fd0-de98-4dd3-9d6c-6ea86f3bfed6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:35.297092 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ed2a9fd0-de98-4dd3-9d6c-6ea86f3bfed6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1722 microversion: 2.20 time: 0.251083 Nov 23 04:20:35.297647 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 402/868] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:35 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:35.925741 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-71bd58cc-8e2d-4a78-aacb-00c135832d90 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:35.926355 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-71bd58cc-8e2d-4a78-aacb-00c135832d90 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:35.934252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-71bd58cc-8e2d-4a78-aacb-00c135832d90 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:35.934682 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-71bd58cc-8e2d-4a78-aacb-00c135832d90 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:35.935542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-71bd58cc-8e2d-4a78-aacb-00c135832d90 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:35.936055 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-71bd58cc-8e2d-4a78-aacb-00c135832d90 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:36.075988 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-71bd58cc-8e2d-4a78-aacb-00c135832d90 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:36.083098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-71bd58cc-8e2d-4a78-aacb-00c135832d90 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.161158 Nov 23 04:20:36.084207 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 467/869] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:35 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:36.315787 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-eda732eb-7522-45cc-8d39-157bbcf2351a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:36.316390 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-eda732eb-7522-45cc-8d39-157bbcf2351a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:36.322738 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eda732eb-7522-45cc-8d39-157bbcf2351a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:36.323185 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eda732eb-7522-45cc-8d39-157bbcf2351a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:36.324065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eda732eb-7522-45cc-8d39-157bbcf2351a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:36.324497 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eda732eb-7522-45cc-8d39-157bbcf2351a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:36.453999 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-eda732eb-7522-45cc-8d39-157bbcf2351a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:36.462287 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-eda732eb-7522-45cc-8d39-157bbcf2351a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:36.463825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-eda732eb-7522-45cc-8d39-157bbcf2351a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:36.464996 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-eda732eb-7522-45cc-8d39-157bbcf2351a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1722 microversion: 2.20 time: 0.152858 Nov 23 04:20:36.465646 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 403/870] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:36 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:37.101124 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d330e711-2c35-4791-84bf-1fe624148693 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:37.101825 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d330e711-2c35-4791-84bf-1fe624148693 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:37.108075 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d330e711-2c35-4791-84bf-1fe624148693 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:37.108526 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d330e711-2c35-4791-84bf-1fe624148693 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:37.109309 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d330e711-2c35-4791-84bf-1fe624148693 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:37.109739 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d330e711-2c35-4791-84bf-1fe624148693 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:37.247572 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d330e711-2c35-4791-84bf-1fe624148693 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:37.254990 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d330e711-2c35-4791-84bf-1fe624148693 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.158636 Nov 23 04:20:37.256138 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 468/871] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:37 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:37.483383 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f64a7f69-1441-4549-a556-e51289f50eae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:37.484021 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f64a7f69-1441-4549-a556-e51289f50eae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:37.491865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f64a7f69-1441-4549-a556-e51289f50eae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:37.492334 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f64a7f69-1441-4549-a556-e51289f50eae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:37.493137 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f64a7f69-1441-4549-a556-e51289f50eae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:37.493577 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f64a7f69-1441-4549-a556-e51289f50eae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:37.628644 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f64a7f69-1441-4549-a556-e51289f50eae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:37.637812 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f64a7f69-1441-4549-a556-e51289f50eae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:37.639326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f64a7f69-1441-4549-a556-e51289f50eae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:37.640456 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f64a7f69-1441-4549-a556-e51289f50eae tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1725 microversion: 2.20 time: 0.161026 Nov 23 04:20:37.641014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 404/872] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:37 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:37.660755 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7257b0cb-fdc0-4a4e-9c9c-10bd4cbc3e67 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "696adab1-d1f9-467d-94f7-d1996dc90f57"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:37.662183 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7257b0cb-fdc0-4a4e-9c9c-10bd4cbc3e67 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:37.669079 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7257b0cb-fdc0-4a4e-9c9c-10bd4cbc3e67 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:37.669530 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7257b0cb-fdc0-4a4e-9c9c-10bd4cbc3e67 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:37.670321 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7257b0cb-fdc0-4a4e-9c9c-10bd4cbc3e67 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:37.670754 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7257b0cb-fdc0-4a4e-9c9c-10bd4cbc3e67 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:37.971798 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-3669cd9f-a84d-40d5-a57c-3377f1501a36 req-acd4091e-b1cd-4941-a2d8-ce308baee90d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2542af4-c4d5-4fc0-b86c-00df6da8fd61", "name": "network-vif-unplugged", "status": "completed", "tag": "ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:37.973358 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:20:37.973358 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:20:37.981858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-3669cd9f-a84d-40d5-a57c-3377f1501a36 req-acd4091e-b1cd-4941-a2d8-ce308baee90d service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:37.982353 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-3669cd9f-a84d-40d5-a57c-3377f1501a36 req-acd4091e-b1cd-4941-a2d8-ce308baee90d service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:37.996152 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-3669cd9f-a84d-40d5-a57c-3377f1501a36 req-acd4091e-b1cd-4941-a2d8-ce308baee90d service nova] Creating event network-vif-unplugged:ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673 for instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 on hv-cinder-76845 Nov 23 04:20:38.001177 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-3669cd9f-a84d-40d5-a57c-3377f1501a36 req-acd4091e-b1cd-4941-a2d8-ce308baee90d service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033290 Nov 23 04:20:38.001782 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 405/873] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:20:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:20:38.273470 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b3781f4d-b128-49ff-aa27-49ccb90f6dfd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:38.274173 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b3781f4d-b128-49ff-aa27-49ccb90f6dfd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:38.280195 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b3781f4d-b128-49ff-aa27-49ccb90f6dfd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:38.280652 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b3781f4d-b128-49ff-aa27-49ccb90f6dfd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:38.281432 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b3781f4d-b128-49ff-aa27-49ccb90f6dfd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:38.281870 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b3781f4d-b128-49ff-aa27-49ccb90f6dfd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:38.417043 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-b3781f4d-b128-49ff-aa27-49ccb90f6dfd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:38.424299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b3781f4d-b128-49ff-aa27-49ccb90f6dfd tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.155768 Nov 23 04:20:38.424865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 406/874] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:38 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:20:38.665864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7257b0cb-fdc0-4a4e-9c9c-10bd4cbc3e67 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.009564 Nov 23 04:20:38.666653 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 469/875] 10.222.0.54 () {62 vars in 1363 bytes} [Tue Nov 23 04:20:37 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/os-volume_attachments => generated 188 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:20:38.781839 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5e21b9c9-5c65-41b6-99f9-21bda02b96c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:38.782338 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5e21b9c9-5c65-41b6-99f9-21bda02b96c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:38.788923 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5e21b9c9-5c65-41b6-99f9-21bda02b96c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:38.789370 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5e21b9c9-5c65-41b6-99f9-21bda02b96c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:38.790163 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5e21b9c9-5c65-41b6-99f9-21bda02b96c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:38.790596 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5e21b9c9-5c65-41b6-99f9-21bda02b96c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:39.438591 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5e21b9c9-5c65-41b6-99f9-21bda02b96c2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "DELETE /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/os-volume_attachments/696adab1-d1f9-467d-94f7-d1996dc90f57" status: 202 len: 0 microversion: 2.20 time: 0.660205 Nov 23 04:20:39.439602 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 407/876] 10.222.0.54 () {60 vars in 1456 bytes} [Tue Nov 23 04:20:38 2021] DELETE /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/os-volume_attachments/696adab1-d1f9-467d-94f7-d1996dc90f57 => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:20:39.444680 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c5b7d5fd-32fb-4cad-accb-6981e3e9ec67 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:39.445442 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c5b7d5fd-32fb-4cad-accb-6981e3e9ec67 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:39.452351 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5b7d5fd-32fb-4cad-accb-6981e3e9ec67 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:39.452796 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5b7d5fd-32fb-4cad-accb-6981e3e9ec67 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:39.453577 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5b7d5fd-32fb-4cad-accb-6981e3e9ec67 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:39.454007 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c5b7d5fd-32fb-4cad-accb-6981e3e9ec67 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:39.496116 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9cde1d34-66c1-44c9-8ede-1954aaa5b0b6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:39.496765 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9cde1d34-66c1-44c9-8ede-1954aaa5b0b6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:39.502586 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9cde1d34-66c1-44c9-8ede-1954aaa5b0b6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:39.503036 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9cde1d34-66c1-44c9-8ede-1954aaa5b0b6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:39.503856 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9cde1d34-66c1-44c9-8ede-1954aaa5b0b6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:39.504320 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9cde1d34-66c1-44c9-8ede-1954aaa5b0b6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:39.592293 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c5b7d5fd-32fb-4cad-accb-6981e3e9ec67 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:39.599711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c5b7d5fd-32fb-4cad-accb-6981e3e9ec67 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.161820 Nov 23 04:20:39.600367 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 470/877] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:39 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:20:39.731216 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9cde1d34-66c1-44c9-8ede-1954aaa5b0b6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [7058a236-4196-45fc-997b-bece9ed9bc33] AMQP server on 10.222.0.54:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 04:20:40.618086 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9800a46e-7135-4ded-865c-5c991afc3423 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:40.618701 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9800a46e-7135-4ded-865c-5c991afc3423 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:40.625113 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9800a46e-7135-4ded-865c-5c991afc3423 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:40.625558 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9800a46e-7135-4ded-865c-5c991afc3423 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:40.626351 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9800a46e-7135-4ded-865c-5c991afc3423 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:40.626784 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9800a46e-7135-4ded-865c-5c991afc3423 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:40.749639 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO oslo.messaging._drivers.impl_rabbit [None req-9cde1d34-66c1-44c9-8ede-1954aaa5b0b6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [7058a236-4196-45fc-997b-bece9ed9bc33] Reconnected to AMQP server on 10.222.0.54:5672 via [amqp] client with port 51510. Nov 23 04:20:40.752931 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9cde1d34-66c1-44c9-8ede-1954aaa5b0b6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action" status: 202 len: 0 microversion: 2.20 time: 1.260748 Nov 23 04:20:40.757748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 408/878] 10.222.0.54 () {62 vars in 1318 bytes} [Tue Nov 23 04:20:39 2021] POST /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/action => generated 0 bytes in 1267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 23 04:20:40.762647 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-29029616-f990-4701-8d93-dbb73f23af4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:40.763336 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-29029616-f990-4701-8d93-dbb73f23af4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:40.769080 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-29029616-f990-4701-8d93-dbb73f23af4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:40.769524 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-29029616-f990-4701-8d93-dbb73f23af4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:40.770402 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-29029616-f990-4701-8d93-dbb73f23af4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:40.771045 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-29029616-f990-4701-8d93-dbb73f23af4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:40.771179 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9800a46e-7135-4ded-865c-5c991afc3423 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:40.784707 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9800a46e-7135-4ded-865c-5c991afc3423 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.170998 Nov 23 04:20:40.786240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 471/879] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:40 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:20:40.917592 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-29029616-f990-4701-8d93-dbb73f23af4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:40.926124 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-29029616-f990-4701-8d93-dbb73f23af4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:40.927636 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-29029616-f990-4701-8d93-dbb73f23af4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:40.929527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-29029616-f990-4701-8d93-dbb73f23af4a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1673 microversion: 2.20 time: 0.169867 Nov 23 04:20:40.930149 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 409/880] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:40 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:41.801725 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-52b0b6d0-7b58-4457-93dd-cf51547b6a0a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:41.802462 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-52b0b6d0-7b58-4457-93dd-cf51547b6a0a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:41.809199 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52b0b6d0-7b58-4457-93dd-cf51547b6a0a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:41.811435 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52b0b6d0-7b58-4457-93dd-cf51547b6a0a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:41.811435 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52b0b6d0-7b58-4457-93dd-cf51547b6a0a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:41.811435 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-52b0b6d0-7b58-4457-93dd-cf51547b6a0a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:41.946378 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-52b0b6d0-7b58-4457-93dd-cf51547b6a0a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:41.947983 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9cad0b57-d915-4aba-973f-4fa261248029 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:41.948664 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9cad0b57-d915-4aba-973f-4fa261248029 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:41.954076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-52b0b6d0-7b58-4457-93dd-cf51547b6a0a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.156075 Nov 23 04:20:41.959364 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 472/881] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:41 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:41.959481 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9cad0b57-d915-4aba-973f-4fa261248029 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:41.959481 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9cad0b57-d915-4aba-973f-4fa261248029 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:41.959481 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9cad0b57-d915-4aba-973f-4fa261248029 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:41.959481 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9cad0b57-d915-4aba-973f-4fa261248029 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:42.094234 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-5d728416-6f19-4a53-8807-c219edb90aba req-7101c584-d09c-42fd-b73e-c7a43b3b9e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe99c22a-d75b-4a5c-8800-6a65d64ded71", "name": "network-vif-plugged", "status": "completed", "tag": "6785c855-b933-47d9-95d0-982e7c07f503"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:42.096726 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:20:42.096726 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:20:42.098138 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9cad0b57-d915-4aba-973f-4fa261248029 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:42.104545 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-5d728416-6f19-4a53-8807-c219edb90aba req-7101c584-d09c-42fd-b73e-c7a43b3b9e58 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:42.104989 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-5d728416-6f19-4a53-8807-c219edb90aba req-7101c584-d09c-42fd-b73e-c7a43b3b9e58 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:42.106952 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9cad0b57-d915-4aba-973f-4fa261248029 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:42.108582 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9cad0b57-d915-4aba-973f-4fa261248029 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:42.110029 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9cad0b57-d915-4aba-973f-4fa261248029 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1673 microversion: 2.20 time: 0.166914 Nov 23 04:20:42.110937 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 410/882] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:41 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:42.120960 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-5d728416-6f19-4a53-8807-c219edb90aba req-7101c584-d09c-42fd-b73e-c7a43b3b9e58 service nova] Creating event network-vif-plugged:6785c855-b933-47d9-95d0-982e7c07f503 for instance fe99c22a-d75b-4a5c-8800-6a65d64ded71 on hv-cinder-76845 Nov 23 04:20:42.123703 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-5d728416-6f19-4a53-8807-c219edb90aba req-7101c584-d09c-42fd-b73e-c7a43b3b9e58 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033236 Nov 23 04:20:42.124470 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 473/883] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:20:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:20:42.971179 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7686e42d-621b-4e0c-a2c2-4372aa028756 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:42.971743 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7686e42d-621b-4e0c-a2c2-4372aa028756 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:42.978769 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7686e42d-621b-4e0c-a2c2-4372aa028756 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:42.979238 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7686e42d-621b-4e0c-a2c2-4372aa028756 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:42.980024 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7686e42d-621b-4e0c-a2c2-4372aa028756 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:42.980462 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7686e42d-621b-4e0c-a2c2-4372aa028756 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:43.126403 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7686e42d-621b-4e0c-a2c2-4372aa028756 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:43.129655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c847b896-d67b-4376-81cc-eab18a5ea52b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:43.130353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c847b896-d67b-4376-81cc-eab18a5ea52b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:43.135018 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7686e42d-621b-4e0c-a2c2-4372aa028756 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1258 microversion: 2.1 time: 0.167467 Nov 23 04:20:43.144279 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 411/884] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:42 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:43.144616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c847b896-d67b-4376-81cc-eab18a5ea52b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:43.144616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c847b896-d67b-4376-81cc-eab18a5ea52b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:43.144616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c847b896-d67b-4376-81cc-eab18a5ea52b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:43.144616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c847b896-d67b-4376-81cc-eab18a5ea52b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:43.358280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c847b896-d67b-4376-81cc-eab18a5ea52b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:43.367070 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c847b896-d67b-4376-81cc-eab18a5ea52b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:43.368642 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c847b896-d67b-4376-81cc-eab18a5ea52b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:43.369815 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c847b896-d67b-4376-81cc-eab18a5ea52b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.244198 Nov 23 04:20:43.370413 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 474/885] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:43 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:44.152000 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ac796c1c-0c7e-4777-bb5f-4e6503f8adb0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:44.152672 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ac796c1c-0c7e-4777-bb5f-4e6503f8adb0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:44.158726 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ac796c1c-0c7e-4777-bb5f-4e6503f8adb0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:44.159168 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ac796c1c-0c7e-4777-bb5f-4e6503f8adb0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:44.159964 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ac796c1c-0c7e-4777-bb5f-4e6503f8adb0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:44.160395 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ac796c1c-0c7e-4777-bb5f-4e6503f8adb0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:44.323590 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ac796c1c-0c7e-4777-bb5f-4e6503f8adb0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:44.331994 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ac796c1c-0c7e-4777-bb5f-4e6503f8adb0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1443 microversion: 2.1 time: 0.184380 Nov 23 04:20:44.332660 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 412/886] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:44 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1443 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:44.333702 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1066390954", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-673532001", "security_groups": [{"name": "tempest-secgroup-smoke-354329014"}], "block_device_mapping_v2": [{"uuid": "e93acbc8-537b-4f6f-8b5d-e920541a3fac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3f5880c1-f079-4dc1-b8fc-71110c737c22"}]}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:44.349452 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1ad6111e-2973-4c75-a3bf-5cd8facc75a1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:44.350062 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1ad6111e-2973-4c75-a3bf-5cd8facc75a1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:44.356658 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ad6111e-2973-4c75-a3bf-5cd8facc75a1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:44.357103 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ad6111e-2973-4c75-a3bf-5cd8facc75a1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:44.357968 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ad6111e-2973-4c75-a3bf-5cd8facc75a1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:44.358408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ad6111e-2973-4c75-a3bf-5cd8facc75a1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:44.499372 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] validate_networks() for [('3f5880c1-f079-4dc1-b8fc-71110c737c22', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:20:44.642428 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1ad6111e-2973-4c75-a3bf-5cd8facc75a1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:44.653577 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1ad6111e-2973-4c75-a3bf-5cd8facc75a1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1443 microversion: 2.1 time: 0.307522 Nov 23 04:20:44.654205 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 413/887] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:44 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1443 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:20:44.685110 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e0acc798-75c5-4a52-a5a3-54244817c88b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:44.685746 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e0acc798-75c5-4a52-a5a3-54244817c88b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:44.691869 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e0acc798-75c5-4a52-a5a3-54244817c88b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:44.692583 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e0acc798-75c5-4a52-a5a3-54244817c88b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:44.693605 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e0acc798-75c5-4a52-a5a3-54244817c88b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:44.694254 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e0acc798-75c5-4a52-a5a3-54244817c88b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:44.984764 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e0acc798-75c5-4a52-a5a3-54244817c88b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:45.001272 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e0acc798-75c5-4a52-a5a3-54244817c88b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:45.004798 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e0acc798-75c5-4a52-a5a3-54244817c88b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:45.009232 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e0acc798-75c5-4a52-a5a3-54244817c88b tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.340220 Nov 23 04:20:45.010249 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 414/888] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:44 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:45.145283 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:20:45.145693 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:20:45.146408 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:20:45.147687 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:20:45.148197 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:20:45.158093 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:45.158887 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:45.159954 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:45.160610 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:45.188356 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Getting quotas for project 8068470657b040ab9af34219d8935846. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:20:45.192671 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Getting quotas for user 97e3605d1b0045e48d5836380ce77dc6 and project 8068470657b040ab9af34219d8935846. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:20:45.281094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:20:45.283203 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e93acbc8-537b-4f6f-8b5d-e920541a3fac',volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:20:45.744859 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-16e780bb-69b4-4857-b17a-b5297b94936f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.413362 Nov 23 04:20:45.747134 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 475/889] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:20:44 2021] POST /compute/v2.1/servers => generated 405 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 23 04:20:45.766860 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-183d3a9f-2a99-4686-8900-4b4f1664324b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:45.769518 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-183d3a9f-2a99-4686-8900-4b4f1664324b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:45.842238 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-183d3a9f-2a99-4686-8900-4b4f1664324b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:45.853224 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-183d3a9f-2a99-4686-8900-4b4f1664324b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1094 microversion: 2.1 time: 0.099324 Nov 23 04:20:45.854356 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 415/890] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:45 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:46.029323 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5e0a7d76-07a0-441f-b609-20612b2bc1fb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:46.029868 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5e0a7d76-07a0-441f-b609-20612b2bc1fb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:46.037103 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5e0a7d76-07a0-441f-b609-20612b2bc1fb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:46.037804 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5e0a7d76-07a0-441f-b609-20612b2bc1fb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:46.038830 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5e0a7d76-07a0-441f-b609-20612b2bc1fb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:46.040120 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5e0a7d76-07a0-441f-b609-20612b2bc1fb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:46.204095 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5e0a7d76-07a0-441f-b609-20612b2bc1fb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:46.213778 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5e0a7d76-07a0-441f-b609-20612b2bc1fb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:46.215332 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5e0a7d76-07a0-441f-b609-20612b2bc1fb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:46.216834 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5e0a7d76-07a0-441f-b609-20612b2bc1fb tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.191506 Nov 23 04:20:46.217474 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 476/891] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:46 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:46.870953 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8ef35fb6-28af-4e4e-8f26-66ff31fd94a4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:46.871753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8ef35fb6-28af-4e4e-8f26-66ff31fd94a4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:46.952595 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8ef35fb6-28af-4e4e-8f26-66ff31fd94a4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:46.960440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8ef35fb6-28af-4e4e-8f26-66ff31fd94a4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1094 microversion: 2.1 time: 0.094380 Nov 23 04:20:46.961159 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 416/892] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:46 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:47.235609 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-34e8bd92-e81e-4fa2-9941-fd43a3e605cf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:47.236220 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-34e8bd92-e81e-4fa2-9941-fd43a3e605cf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:47.254862 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-34e8bd92-e81e-4fa2-9941-fd43a3e605cf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:47.258598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-34e8bd92-e81e-4fa2-9941-fd43a3e605cf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:47.258598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-34e8bd92-e81e-4fa2-9941-fd43a3e605cf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:47.258598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-34e8bd92-e81e-4fa2-9941-fd43a3e605cf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:47.366727 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-d34b54cf-306e-4c15-b385-ea423dd143c1 req-936a06d5-7aaf-4819-9590-2da4550448b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe99c22a-d75b-4a5c-8800-6a65d64ded71", "tag": "6785c855-b933-47d9-95d0-982e7c07f503"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:47.369783 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:20:47.369783 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:20:47.382819 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-d34b54cf-306e-4c15-b385-ea423dd143c1 req-936a06d5-7aaf-4819-9590-2da4550448b7 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:47.384486 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-d34b54cf-306e-4c15-b385-ea423dd143c1 req-936a06d5-7aaf-4819-9590-2da4550448b7 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:47.404899 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-d34b54cf-306e-4c15-b385-ea423dd143c1 req-936a06d5-7aaf-4819-9590-2da4550448b7 service nova] Creating event network-changed:6785c855-b933-47d9-95d0-982e7c07f503 for instance fe99c22a-d75b-4a5c-8800-6a65d64ded71 on hv-cinder-76845 Nov 23 04:20:47.414676 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-d34b54cf-306e-4c15-b385-ea423dd143c1 req-936a06d5-7aaf-4819-9590-2da4550448b7 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055129 Nov 23 04:20:47.415476 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 417/893] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:20:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:20:47.481397 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-34e8bd92-e81e-4fa2-9941-fd43a3e605cf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:47.500654 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-34e8bd92-e81e-4fa2-9941-fd43a3e605cf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:47.512329 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-34e8bd92-e81e-4fa2-9941-fd43a3e605cf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:47.513646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-34e8bd92-e81e-4fa2-9941-fd43a3e605cf tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.281631 Nov 23 04:20:47.514770 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 477/894] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:47 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:47.979858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-498d20b0-9410-4062-a5cf-6dd03a146f25 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:47.981557 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-498d20b0-9410-4062-a5cf-6dd03a146f25 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:47.992964 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-498d20b0-9410-4062-a5cf-6dd03a146f25 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:47.993422 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-498d20b0-9410-4062-a5cf-6dd03a146f25 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:47.994231 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-498d20b0-9410-4062-a5cf-6dd03a146f25 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:47.994665 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-498d20b0-9410-4062-a5cf-6dd03a146f25 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:48.069596 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-498d20b0-9410-4062-a5cf-6dd03a146f25 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:48.077690 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-498d20b0-9410-4062-a5cf-6dd03a146f25 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1144 microversion: 2.1 time: 0.103364 Nov 23 04:20:48.078808 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 418/895] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:47 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1144 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:48.534286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d0ce111d-1e09-463f-84d1-242d7be18844 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:48.535131 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d0ce111d-1e09-463f-84d1-242d7be18844 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:48.544086 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d0ce111d-1e09-463f-84d1-242d7be18844 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:48.544529 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d0ce111d-1e09-463f-84d1-242d7be18844 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:48.545582 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d0ce111d-1e09-463f-84d1-242d7be18844 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:48.546018 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d0ce111d-1e09-463f-84d1-242d7be18844 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:48.715701 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d0ce111d-1e09-463f-84d1-242d7be18844 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:48.724673 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d0ce111d-1e09-463f-84d1-242d7be18844 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:48.726288 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d0ce111d-1e09-463f-84d1-242d7be18844 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:48.727543 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d0ce111d-1e09-463f-84d1-242d7be18844 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.197432 Nov 23 04:20:48.728106 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 478/896] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:48 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:49.097198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5da424ce-1bcf-4d32-a6c3-5ed43b6bf252 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:49.098595 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5da424ce-1bcf-4d32-a6c3-5ed43b6bf252 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:49.109144 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5da424ce-1bcf-4d32-a6c3-5ed43b6bf252 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:49.109598 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5da424ce-1bcf-4d32-a6c3-5ed43b6bf252 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:49.110614 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5da424ce-1bcf-4d32-a6c3-5ed43b6bf252 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:49.111237 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5da424ce-1bcf-4d32-a6c3-5ed43b6bf252 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:49.194654 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5da424ce-1bcf-4d32-a6c3-5ed43b6bf252 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:49.203245 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5da424ce-1bcf-4d32-a6c3-5ed43b6bf252 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1144 microversion: 2.1 time: 0.110988 Nov 23 04:20:49.203993 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 419/897] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:49 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1144 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:49.746684 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ca9148e7-b66c-45cc-be91-56c9d4f5d06d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:49.747352 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ca9148e7-b66c-45cc-be91-56c9d4f5d06d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:49.753787 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca9148e7-b66c-45cc-be91-56c9d4f5d06d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:49.754234 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca9148e7-b66c-45cc-be91-56c9d4f5d06d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:49.755198 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca9148e7-b66c-45cc-be91-56c9d4f5d06d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:49.755649 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca9148e7-b66c-45cc-be91-56c9d4f5d06d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:49.904783 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ca9148e7-b66c-45cc-be91-56c9d4f5d06d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:49.913349 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ca9148e7-b66c-45cc-be91-56c9d4f5d06d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:49.915903 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ca9148e7-b66c-45cc-be91-56c9d4f5d06d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:49.917222 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ca9148e7-b66c-45cc-be91-56c9d4f5d06d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.175163 Nov 23 04:20:49.921231 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 479/898] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:49 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:50.225857 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e2736169-845f-494b-a4ac-ccd9c791b205 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:50.226714 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e2736169-845f-494b-a4ac-ccd9c791b205 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:50.233900 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e2736169-845f-494b-a4ac-ccd9c791b205 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:50.234352 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e2736169-845f-494b-a4ac-ccd9c791b205 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:50.235382 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e2736169-845f-494b-a4ac-ccd9c791b205 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:50.235983 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e2736169-845f-494b-a4ac-ccd9c791b205 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:50.300787 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e2736169-845f-494b-a4ac-ccd9c791b205 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:50.308895 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e2736169-845f-494b-a4ac-ccd9c791b205 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1144 microversion: 2.1 time: 0.086532 Nov 23 04:20:50.310247 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 420/899] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:50 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:50.936677 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-20cfa4c2-47a2-472e-af79-5cfb53da574a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:50.937292 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-20cfa4c2-47a2-472e-af79-5cfb53da574a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:50.945061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20cfa4c2-47a2-472e-af79-5cfb53da574a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:50.946650 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20cfa4c2-47a2-472e-af79-5cfb53da574a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:50.947564 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20cfa4c2-47a2-472e-af79-5cfb53da574a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:50.948136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-20cfa4c2-47a2-472e-af79-5cfb53da574a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:51.089110 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-20cfa4c2-47a2-472e-af79-5cfb53da574a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:51.097511 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-20cfa4c2-47a2-472e-af79-5cfb53da574a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:51.099004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-20cfa4c2-47a2-472e-af79-5cfb53da574a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:51.100195 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-20cfa4c2-47a2-472e-af79-5cfb53da574a tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.167585 Nov 23 04:20:51.101247 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 480/900] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:50 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:51.325893 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7e9e4408-227b-4479-8e15-f24c09b5856c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:51.326781 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7e9e4408-227b-4479-8e15-f24c09b5856c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:51.333032 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7e9e4408-227b-4479-8e15-f24c09b5856c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:51.333479 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7e9e4408-227b-4479-8e15-f24c09b5856c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:51.334263 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7e9e4408-227b-4479-8e15-f24c09b5856c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:51.334696 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7e9e4408-227b-4479-8e15-f24c09b5856c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:51.396158 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7e9e4408-227b-4479-8e15-f24c09b5856c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:51.406540 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7e9e4408-227b-4479-8e15-f24c09b5856c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1144 microversion: 2.1 time: 0.084348 Nov 23 04:20:51.410412 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 421/901] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:51 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:52.119573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-31488ee9-82b4-4603-abb2-abf101cc2a4c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:52.121426 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-31488ee9-82b4-4603-abb2-abf101cc2a4c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:52.129174 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-31488ee9-82b4-4603-abb2-abf101cc2a4c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:52.129615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-31488ee9-82b4-4603-abb2-abf101cc2a4c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:52.130418 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-31488ee9-82b4-4603-abb2-abf101cc2a4c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:52.130913 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-31488ee9-82b4-4603-abb2-abf101cc2a4c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:52.280393 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-31488ee9-82b4-4603-abb2-abf101cc2a4c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:52.289344 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-31488ee9-82b4-4603-abb2-abf101cc2a4c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:52.291688 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-31488ee9-82b4-4603-abb2-abf101cc2a4c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:52.292878 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-31488ee9-82b4-4603-abb2-abf101cc2a4c tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.178578 Nov 23 04:20:52.293578 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 481/902] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:52 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:52.424756 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5569191e-567d-4dad-972f-1c2bac65440d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:52.425409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5569191e-567d-4dad-972f-1c2bac65440d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:52.432923 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5569191e-567d-4dad-972f-1c2bac65440d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:52.433378 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5569191e-567d-4dad-972f-1c2bac65440d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:52.434181 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5569191e-567d-4dad-972f-1c2bac65440d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:52.434621 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5569191e-567d-4dad-972f-1c2bac65440d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:52.497449 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5569191e-567d-4dad-972f-1c2bac65440d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:52.504873 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5569191e-567d-4dad-972f-1c2bac65440d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1144 microversion: 2.1 time: 0.084188 Nov 23 04:20:52.505463 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 422/903] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:52 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:53.311353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2ac8105f-38ef-45d8-bcda-b73d523b380d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:53.311921 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2ac8105f-38ef-45d8-bcda-b73d523b380d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:53.318133 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2ac8105f-38ef-45d8-bcda-b73d523b380d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:53.318548 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2ac8105f-38ef-45d8-bcda-b73d523b380d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:53.319367 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2ac8105f-38ef-45d8-bcda-b73d523b380d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:53.319804 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2ac8105f-38ef-45d8-bcda-b73d523b380d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:53.473757 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2ac8105f-38ef-45d8-bcda-b73d523b380d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:53.482933 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2ac8105f-38ef-45d8-bcda-b73d523b380d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:53.489840 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2ac8105f-38ef-45d8-bcda-b73d523b380d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:53.489840 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2ac8105f-38ef-45d8-bcda-b73d523b380d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.179069 Nov 23 04:20:53.489840 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 482/904] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:53 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:53.521817 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9182cdd4-2818-4078-a3bc-28cd886bb175 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:53.522529 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9182cdd4-2818-4078-a3bc-28cd886bb175 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:53.529781 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9182cdd4-2818-4078-a3bc-28cd886bb175 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:53.530230 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9182cdd4-2818-4078-a3bc-28cd886bb175 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:53.531019 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9182cdd4-2818-4078-a3bc-28cd886bb175 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:53.531490 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9182cdd4-2818-4078-a3bc-28cd886bb175 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:53.602891 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9182cdd4-2818-4078-a3bc-28cd886bb175 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:53.610427 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9182cdd4-2818-4078-a3bc-28cd886bb175 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1144 microversion: 2.1 time: 0.092349 Nov 23 04:20:53.611008 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 423/905] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:53 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:20:54.504194 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a1d7f362-375e-42e1-932a-c1098e9de275 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:54.504801 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a1d7f362-375e-42e1-932a-c1098e9de275 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:54.511789 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1d7f362-375e-42e1-932a-c1098e9de275 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:54.513564 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1d7f362-375e-42e1-932a-c1098e9de275 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:54.513564 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1d7f362-375e-42e1-932a-c1098e9de275 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:54.513564 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a1d7f362-375e-42e1-932a-c1098e9de275 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:54.627182 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-55cee65a-8666-42bf-94c5-b29907baa2ac tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:54.627817 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-55cee65a-8666-42bf-94c5-b29907baa2ac tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:54.634210 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-55cee65a-8666-42bf-94c5-b29907baa2ac tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:54.634666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-55cee65a-8666-42bf-94c5-b29907baa2ac tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:54.636254 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-55cee65a-8666-42bf-94c5-b29907baa2ac tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:54.636700 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-55cee65a-8666-42bf-94c5-b29907baa2ac tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:54.642792 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a1d7f362-375e-42e1-932a-c1098e9de275 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:54.650530 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a1d7f362-375e-42e1-932a-c1098e9de275 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:54.652144 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a1d7f362-375e-42e1-932a-c1098e9de275 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:54.653286 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a1d7f362-375e-42e1-932a-c1098e9de275 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.152757 Nov 23 04:20:54.653908 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 483/906] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:54 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:54.695861 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-55cee65a-8666-42bf-94c5-b29907baa2ac tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:54.704056 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-55cee65a-8666-42bf-94c5-b29907baa2ac tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1144 microversion: 2.1 time: 0.080482 Nov 23 04:20:54.704636 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 424/907] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:54 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:20:55.670525 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4ad22685-4b51-4ef9-924c-ae94e4a88f85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:55.671126 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4ad22685-4b51-4ef9-924c-ae94e4a88f85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:55.677368 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4ad22685-4b51-4ef9-924c-ae94e4a88f85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:55.677820 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4ad22685-4b51-4ef9-924c-ae94e4a88f85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:55.678671 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4ad22685-4b51-4ef9-924c-ae94e4a88f85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:55.679110 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4ad22685-4b51-4ef9-924c-ae94e4a88f85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:55.721053 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d8ba24f7-d73c-4617-a8c0-abe14561ee68 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:55.721766 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d8ba24f7-d73c-4617-a8c0-abe14561ee68 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:55.731320 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d8ba24f7-d73c-4617-a8c0-abe14561ee68 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:55.731656 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d8ba24f7-d73c-4617-a8c0-abe14561ee68 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:55.732536 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d8ba24f7-d73c-4617-a8c0-abe14561ee68 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:55.733035 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d8ba24f7-d73c-4617-a8c0-abe14561ee68 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:55.821396 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d8ba24f7-d73c-4617-a8c0-abe14561ee68 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:55.828954 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d8ba24f7-d73c-4617-a8c0-abe14561ee68 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1192 microversion: 2.1 time: 0.111679 Nov 23 04:20:55.829527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 425/908] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:55 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:20:55.841487 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4ad22685-4b51-4ef9-924c-ae94e4a88f85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:55.846106 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4ad22685-4b51-4ef9-924c-ae94e4a88f85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:55.847637 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4ad22685-4b51-4ef9-924c-ae94e4a88f85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:55.848800 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4ad22685-4b51-4ef9-924c-ae94e4a88f85 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.182168 Nov 23 04:20:55.849354 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 484/909] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:55 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:56.849304 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8dc818fe-f886-45f3-85f4-ffeb13468883 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:56.849949 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8dc818fe-f886-45f3-85f4-ffeb13468883 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:56.858827 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8dc818fe-f886-45f3-85f4-ffeb13468883 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:56.859300 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8dc818fe-f886-45f3-85f4-ffeb13468883 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:56.860090 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8dc818fe-f886-45f3-85f4-ffeb13468883 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:56.860520 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8dc818fe-f886-45f3-85f4-ffeb13468883 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:56.868629 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3648674e-a9ea-407e-a0c6-3f7d94e54297 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:56.869269 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3648674e-a9ea-407e-a0c6-3f7d94e54297 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:56.878470 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3648674e-a9ea-407e-a0c6-3f7d94e54297 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:56.879183 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3648674e-a9ea-407e-a0c6-3f7d94e54297 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:56.879998 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3648674e-a9ea-407e-a0c6-3f7d94e54297 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:56.880428 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3648674e-a9ea-407e-a0c6-3f7d94e54297 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:57.460900 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8dc818fe-f886-45f3-85f4-ffeb13468883 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:57.468738 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8dc818fe-f886-45f3-85f4-ffeb13468883 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1277 microversion: 2.1 time: 0.623138 Nov 23 04:20:57.469606 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 426/910] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:56 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1277 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:57.478164 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3648674e-a9ea-407e-a0c6-3f7d94e54297 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:57.486591 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3648674e-a9ea-407e-a0c6-3f7d94e54297 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:57.488249 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3648674e-a9ea-407e-a0c6-3f7d94e54297 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:57.489385 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3648674e-a9ea-407e-a0c6-3f7d94e54297 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.624542 Nov 23 04:20:57.490008 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 485/911] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:56 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:58.028922 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-35f82d1f-0494-4101-a993-d7d8a1466740 req-f9d9b12a-60fd-4454-a92d-2aceb557c8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94641710-5efb-41aa-acde-03bacf08f49e", "tag": "2df4ffb6-9def-4b79-91c3-ffeb6dc7fd68"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:20:58.036770 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:20:58.036770 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:20:58.040409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-35f82d1f-0494-4101-a993-d7d8a1466740 req-f9d9b12a-60fd-4454-a92d-2aceb557c8f3 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:58.040854 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-35f82d1f-0494-4101-a993-d7d8a1466740 req-f9d9b12a-60fd-4454-a92d-2aceb557c8f3 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:58.053329 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-35f82d1f-0494-4101-a993-d7d8a1466740 req-f9d9b12a-60fd-4454-a92d-2aceb557c8f3 service nova] Creating event network-changed:2df4ffb6-9def-4b79-91c3-ffeb6dc7fd68 for instance 94641710-5efb-41aa-acde-03bacf08f49e on hv-cinder-76845 Nov 23 04:20:58.059290 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-35f82d1f-0494-4101-a993-d7d8a1466740 req-f9d9b12a-60fd-4454-a92d-2aceb557c8f3 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036000 Nov 23 04:20:58.062376 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 427/912] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:20:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:20:58.486805 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c1085e70-09d7-425c-b24b-59e891136ebe tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:58.489230 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c1085e70-09d7-425c-b24b-59e891136ebe tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:58.493580 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1085e70-09d7-425c-b24b-59e891136ebe tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:58.494040 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1085e70-09d7-425c-b24b-59e891136ebe tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:58.494826 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1085e70-09d7-425c-b24b-59e891136ebe tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:58.495310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c1085e70-09d7-425c-b24b-59e891136ebe tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:58.508865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bdc8d3d3-ef87-4e56-9efc-eeacc9434cfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:58.509562 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-bdc8d3d3-ef87-4e56-9efc-eeacc9434cfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:58.516336 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bdc8d3d3-ef87-4e56-9efc-eeacc9434cfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:58.516833 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bdc8d3d3-ef87-4e56-9efc-eeacc9434cfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:58.523977 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bdc8d3d3-ef87-4e56-9efc-eeacc9434cfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:58.523977 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bdc8d3d3-ef87-4e56-9efc-eeacc9434cfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:58.770214 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c1085e70-09d7-425c-b24b-59e891136ebe tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:58.778514 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c1085e70-09d7-425c-b24b-59e891136ebe tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1265 microversion: 2.1 time: 0.295410 Nov 23 04:20:58.786722 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 486/913] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:58 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:20:58.796572 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bdc8d3d3-ef87-4e56-9efc-eeacc9434cfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:58.804236 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bdc8d3d3-ef87-4e56-9efc-eeacc9434cfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:58.805715 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bdc8d3d3-ef87-4e56-9efc-eeacc9434cfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:20:58.806847 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bdc8d3d3-ef87-4e56-9efc-eeacc9434cfc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.302237 Nov 23 04:20:58.807434 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 428/914] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:58 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:20:59.795764 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0d056cf0-af5b-4a8f-aabb-654e8dc8831e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:59.796454 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0d056cf0-af5b-4a8f-aabb-654e8dc8831e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:59.802669 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0d056cf0-af5b-4a8f-aabb-654e8dc8831e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:59.803109 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0d056cf0-af5b-4a8f-aabb-654e8dc8831e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:59.803916 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0d056cf0-af5b-4a8f-aabb-654e8dc8831e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:59.804345 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0d056cf0-af5b-4a8f-aabb-654e8dc8831e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:59.823626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4364304b-30ca-4cbb-87ca-4afb62364659 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:20:59.825479 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4364304b-30ca-4cbb-87ca-4afb62364659 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:20:59.831946 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4364304b-30ca-4cbb-87ca-4afb62364659 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:59.832475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4364304b-30ca-4cbb-87ca-4afb62364659 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:20:59.833329 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4364304b-30ca-4cbb-87ca-4afb62364659 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:20:59.833863 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4364304b-30ca-4cbb-87ca-4afb62364659 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:00.004088 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0d056cf0-af5b-4a8f-aabb-654e8dc8831e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:00.011725 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4364304b-30ca-4cbb-87ca-4afb62364659 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:00.012142 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0d056cf0-af5b-4a8f-aabb-654e8dc8831e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1265 microversion: 2.1 time: 0.219924 Nov 23 04:21:00.012940 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 487/915] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:20:59 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:00.020688 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4364304b-30ca-4cbb-87ca-4afb62364659 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:00.022325 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4364304b-30ca-4cbb-87ca-4afb62364659 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:00.023580 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4364304b-30ca-4cbb-87ca-4afb62364659 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.203614 Nov 23 04:21:00.024134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 429/916] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:20:59 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:21:00.148494 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-91e48f7d-201b-4122-9cc1-0bec3e0042f7 req-4cfc1728-cb5a-44b7-8ac7-492fca206534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2542af4-c4d5-4fc0-b86c-00df6da8fd61", "name": "network-vif-plugged", "status": "completed", "tag": "ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:21:00.150057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:21:00.150057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:21:00.157559 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-91e48f7d-201b-4122-9cc1-0bec3e0042f7 req-4cfc1728-cb5a-44b7-8ac7-492fca206534 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:00.158001 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-91e48f7d-201b-4122-9cc1-0bec3e0042f7 req-4cfc1728-cb5a-44b7-8ac7-492fca206534 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:00.171314 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-91e48f7d-201b-4122-9cc1-0bec3e0042f7 req-4cfc1728-cb5a-44b7-8ac7-492fca206534 service nova] Creating event network-vif-plugged:ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673 for instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 on hv-cinder-76845 Nov 23 04:21:00.176236 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-91e48f7d-201b-4122-9cc1-0bec3e0042f7 req-4cfc1728-cb5a-44b7-8ac7-492fca206534 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031365 Nov 23 04:21:00.176815 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 488/917] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:21:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:21:01.029759 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c8e19ddc-b19a-4c1e-b917-0e54d148163c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:01.030367 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c8e19ddc-b19a-4c1e-b917-0e54d148163c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:01.036846 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c8e19ddc-b19a-4c1e-b917-0e54d148163c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:01.037291 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c8e19ddc-b19a-4c1e-b917-0e54d148163c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:01.038064 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c8e19ddc-b19a-4c1e-b917-0e54d148163c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:01.038494 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c8e19ddc-b19a-4c1e-b917-0e54d148163c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:01.043343 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-214db1de-a314-4905-8954-5879cfccee42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:01.044091 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-214db1de-a314-4905-8954-5879cfccee42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:01.050131 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-214db1de-a314-4905-8954-5879cfccee42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:01.050585 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-214db1de-a314-4905-8954-5879cfccee42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:01.051433 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-214db1de-a314-4905-8954-5879cfccee42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:01.051874 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-214db1de-a314-4905-8954-5879cfccee42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:01.237451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c8e19ddc-b19a-4c1e-b917-0e54d148163c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:01.240748 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-214db1de-a314-4905-8954-5879cfccee42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:01.245076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c8e19ddc-b19a-4c1e-b917-0e54d148163c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1265 microversion: 2.1 time: 0.218815 Nov 23 04:21:01.246508 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 430/918] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:01 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:01.249343 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-214db1de-a314-4905-8954-5879cfccee42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:01.250809 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-214db1de-a314-4905-8954-5879cfccee42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:01.251982 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-214db1de-a314-4905-8954-5879cfccee42 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.213724 Nov 23 04:21:01.257757 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 489/919] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:21:01 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:21:02.261785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a09edfe4-4ba9-4acc-a334-d90a92344eaa tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:02.262672 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a09edfe4-4ba9-4acc-a334-d90a92344eaa tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:02.269147 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a09edfe4-4ba9-4acc-a334-d90a92344eaa tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:02.269548 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-07ba2298-a8d9-4980-ad6d-3b0874d71657 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:02.269952 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a09edfe4-4ba9-4acc-a334-d90a92344eaa tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:02.277586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-07ba2298-a8d9-4980-ad6d-3b0874d71657 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:02.277785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a09edfe4-4ba9-4acc-a334-d90a92344eaa tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:02.277785 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a09edfe4-4ba9-4acc-a334-d90a92344eaa tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:02.278106 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-07ba2298-a8d9-4980-ad6d-3b0874d71657 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:02.278106 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-07ba2298-a8d9-4980-ad6d-3b0874d71657 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:02.278374 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-07ba2298-a8d9-4980-ad6d-3b0874d71657 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:02.278735 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-07ba2298-a8d9-4980-ad6d-3b0874d71657 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:02.468691 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a09edfe4-4ba9-4acc-a334-d90a92344eaa tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:02.472926 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-07ba2298-a8d9-4980-ad6d-3b0874d71657 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:02.476386 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a09edfe4-4ba9-4acc-a334-d90a92344eaa tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1265 microversion: 2.1 time: 0.218219 Nov 23 04:21:02.476966 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 431/920] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:02 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:02.481235 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-07ba2298-a8d9-4980-ad6d-3b0874d71657 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:02.484717 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-07ba2298-a8d9-4980-ad6d-3b0874d71657 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:02.484717 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-07ba2298-a8d9-4980-ad6d-3b0874d71657 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1731 microversion: 2.20 time: 0.218139 Nov 23 04:21:02.484717 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 490/921] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:21:02 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:21:03.493405 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9b97ad65-6610-451f-af98-d74f508bb981 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:03.494020 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9b97ad65-6610-451f-af98-d74f508bb981 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:03.500676 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b97ad65-6610-451f-af98-d74f508bb981 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:03.501128 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b97ad65-6610-451f-af98-d74f508bb981 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:03.501612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-65bf45d7-48f0-4dae-9751-5c2705f64c7f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:03.502028 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b97ad65-6610-451f-af98-d74f508bb981 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:03.502222 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-65bf45d7-48f0-4dae-9751-5c2705f64c7f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:03.502326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b97ad65-6610-451f-af98-d74f508bb981 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:03.508568 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65bf45d7-48f0-4dae-9751-5c2705f64c7f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:03.509019 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65bf45d7-48f0-4dae-9751-5c2705f64c7f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:03.509810 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65bf45d7-48f0-4dae-9751-5c2705f64c7f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:03.513764 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-65bf45d7-48f0-4dae-9751-5c2705f64c7f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:03.698403 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9b97ad65-6610-451f-af98-d74f508bb981 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:03.706118 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-65bf45d7-48f0-4dae-9751-5c2705f64c7f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:03.706474 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9b97ad65-6610-451f-af98-d74f508bb981 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1265 microversion: 2.1 time: 0.216690 Nov 23 04:21:03.707072 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 432/922] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:03 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:03.713817 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-65bf45d7-48f0-4dae-9751-5c2705f64c7f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:03.715501 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-65bf45d7-48f0-4dae-9751-5c2705f64c7f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:03.716656 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-65bf45d7-48f0-4dae-9751-5c2705f64c7f tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1718 microversion: 2.20 time: 0.218797 Nov 23 04:21:03.717215 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 491/923] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:21:03 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1718 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 23 04:21:04.723141 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-95d85cbc-44f3-4d09-a34a-dd3a07728c76 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:04.723789 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-95d85cbc-44f3-4d09-a34a-dd3a07728c76 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:04.730681 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-95d85cbc-44f3-4d09-a34a-dd3a07728c76 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:04.732709 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-95d85cbc-44f3-4d09-a34a-dd3a07728c76 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:04.732709 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-95d85cbc-44f3-4d09-a34a-dd3a07728c76 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:04.732958 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-95d85cbc-44f3-4d09-a34a-dd3a07728c76 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:04.864372 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-95d85cbc-44f3-4d09-a34a-dd3a07728c76 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:04.872282 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-95d85cbc-44f3-4d09-a34a-dd3a07728c76 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1265 microversion: 2.1 time: 0.152829 Nov 23 04:21:04.872846 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 433/924] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:04 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:05.889835 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-32286edb-d2a7-4f5e-97fd-ca4f1ebb74bf tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:05.890449 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-32286edb-d2a7-4f5e-97fd-ca4f1ebb74bf tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:05.896647 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-32286edb-d2a7-4f5e-97fd-ca4f1ebb74bf tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:05.897087 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-32286edb-d2a7-4f5e-97fd-ca4f1ebb74bf tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:05.897856 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-32286edb-d2a7-4f5e-97fd-ca4f1ebb74bf tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:05.898284 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-32286edb-d2a7-4f5e-97fd-ca4f1ebb74bf tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:06.030797 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-32286edb-d2a7-4f5e-97fd-ca4f1ebb74bf tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:06.039293 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-32286edb-d2a7-4f5e-97fd-ca4f1ebb74bf tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1265 microversion: 2.1 time: 0.153935 Nov 23 04:21:06.039812 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 492/925] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:05 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:07.056070 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a0fc6589-c44f-435e-b092-28125da4c907 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:07.056683 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a0fc6589-c44f-435e-b092-28125da4c907 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:07.063090 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a0fc6589-c44f-435e-b092-28125da4c907 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:07.063570 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a0fc6589-c44f-435e-b092-28125da4c907 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:07.064355 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a0fc6589-c44f-435e-b092-28125da4c907 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:07.064787 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a0fc6589-c44f-435e-b092-28125da4c907 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:07.194189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a0fc6589-c44f-435e-b092-28125da4c907 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:07.201937 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a0fc6589-c44f-435e-b092-28125da4c907 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1265 microversion: 2.1 time: 0.149505 Nov 23 04:21:07.202513 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 434/926] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:07 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:21:08.218854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e72491e2-94a9-49be-9114-d569f58ba896 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:08.219493 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e72491e2-94a9-49be-9114-d569f58ba896 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:08.225635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e72491e2-94a9-49be-9114-d569f58ba896 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:08.226103 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e72491e2-94a9-49be-9114-d569f58ba896 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:08.226873 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e72491e2-94a9-49be-9114-d569f58ba896 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:08.227339 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e72491e2-94a9-49be-9114-d569f58ba896 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:08.243127 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-173bea06-3ddb-48de-927e-56e0df662339 req-57b9489b-cf3b-439c-8580-7a5b36a55f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94641710-5efb-41aa-acde-03bacf08f49e", "name": "network-vif-plugged", "status": "completed", "tag": "2df4ffb6-9def-4b79-91c3-ffeb6dc7fd68"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:21:08.244793 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:21:08.244793 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:21:08.252202 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-173bea06-3ddb-48de-927e-56e0df662339 req-57b9489b-cf3b-439c-8580-7a5b36a55f3f service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:08.252648 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-173bea06-3ddb-48de-927e-56e0df662339 req-57b9489b-cf3b-439c-8580-7a5b36a55f3f service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:08.263868 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-173bea06-3ddb-48de-927e-56e0df662339 req-57b9489b-cf3b-439c-8580-7a5b36a55f3f service nova] Creating event network-vif-plugged:2df4ffb6-9def-4b79-91c3-ffeb6dc7fd68 for instance 94641710-5efb-41aa-acde-03bacf08f49e on hv-cinder-76845 Nov 23 04:21:08.268830 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-173bea06-3ddb-48de-927e-56e0df662339 req-57b9489b-cf3b-439c-8580-7a5b36a55f3f service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029376 Nov 23 04:21:08.269463 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 435/927] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:21:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:21:08.366566 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e72491e2-94a9-49be-9114-d569f58ba896 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:08.374901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e72491e2-94a9-49be-9114-d569f58ba896 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1265 microversion: 2.1 time: 0.160390 Nov 23 04:21:08.375524 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 493/928] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:08 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:09.392758 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-14688215-63a2-4bd9-8b52-a6b7626b99fd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:09.393458 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-14688215-63a2-4bd9-8b52-a6b7626b99fd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:09.399559 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-14688215-63a2-4bd9-8b52-a6b7626b99fd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:09.400008 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-14688215-63a2-4bd9-8b52-a6b7626b99fd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:09.400787 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-14688215-63a2-4bd9-8b52-a6b7626b99fd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:09.401222 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-14688215-63a2-4bd9-8b52-a6b7626b99fd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:09.534996 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-14688215-63a2-4bd9-8b52-a6b7626b99fd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:09.542663 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-14688215-63a2-4bd9-8b52-a6b7626b99fd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1265 microversion: 2.1 time: 0.154454 Nov 23 04:21:09.543900 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 436/929] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:09 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:10.560876 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f8cf2277-934a-4c86-87cb-ff7eb863f890 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:10.561463 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f8cf2277-934a-4c86-87cb-ff7eb863f890 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:10.567295 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8cf2277-934a-4c86-87cb-ff7eb863f890 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:10.567742 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8cf2277-934a-4c86-87cb-ff7eb863f890 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:10.568526 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8cf2277-934a-4c86-87cb-ff7eb863f890 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:10.568935 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f8cf2277-934a-4c86-87cb-ff7eb863f890 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:10.706412 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f8cf2277-934a-4c86-87cb-ff7eb863f890 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:10.713635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f8cf2277-934a-4c86-87cb-ff7eb863f890 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1452 microversion: 2.1 time: 0.157280 Nov 23 04:21:10.714229 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 494/930] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:10 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:10.729597 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-232088f7-cd7b-467f-8a2c-632af7ec7d30 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:10.730209 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-232088f7-cd7b-467f-8a2c-632af7ec7d30 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:10.737146 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-232088f7-cd7b-467f-8a2c-632af7ec7d30 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:10.737581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-232088f7-cd7b-467f-8a2c-632af7ec7d30 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:10.738357 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-232088f7-cd7b-467f-8a2c-632af7ec7d30 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:10.738791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-232088f7-cd7b-467f-8a2c-632af7ec7d30 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:10.869495 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-232088f7-cd7b-467f-8a2c-632af7ec7d30 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:10.877500 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-232088f7-cd7b-467f-8a2c-632af7ec7d30 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1452 microversion: 2.1 time: 0.151569 Nov 23 04:21:10.878067 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 437/931] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:10 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:12.859279 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-8a6be9c6-7977-4e54-b2f2-b7d4419f2b42 req-496837a2-5c4b-411d-b979-d5bb2b02c533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94641710-5efb-41aa-acde-03bacf08f49e", "tag": "2df4ffb6-9def-4b79-91c3-ffeb6dc7fd68"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:21:12.860693 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:21:12.860693 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:21:12.867751 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-8a6be9c6-7977-4e54-b2f2-b7d4419f2b42 req-496837a2-5c4b-411d-b979-d5bb2b02c533 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:12.868197 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-8a6be9c6-7977-4e54-b2f2-b7d4419f2b42 req-496837a2-5c4b-411d-b979-d5bb2b02c533 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:12.879504 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-8a6be9c6-7977-4e54-b2f2-b7d4419f2b42 req-496837a2-5c4b-411d-b979-d5bb2b02c533 service nova] Creating event network-changed:2df4ffb6-9def-4b79-91c3-ffeb6dc7fd68 for instance 94641710-5efb-41aa-acde-03bacf08f49e on hv-cinder-76845 Nov 23 04:21:12.884540 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-8a6be9c6-7977-4e54-b2f2-b7d4419f2b42 req-496837a2-5c4b-411d-b979-d5bb2b02c533 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032043 Nov 23 04:21:12.885127 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 495/932] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:21:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:21:36.679627 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bf0066be-1182-45b0-a917-8a60fc0d2f80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:36.680716 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-bf0066be-1182-45b0-a917-8a60fc0d2f80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:36.688092 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bf0066be-1182-45b0-a917-8a60fc0d2f80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:36.688546 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bf0066be-1182-45b0-a917-8a60fc0d2f80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:36.689332 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bf0066be-1182-45b0-a917-8a60fc0d2f80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:36.689853 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bf0066be-1182-45b0-a917-8a60fc0d2f80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:36.719582 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bf0066be-1182-45b0-a917-8a60fc0d2f80 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043631 Nov 23 04:21:36.720142 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 438/933] 10.222.0.54 () {60 vars in 1342 bytes} [Tue Nov 23 04:21:36 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:36.790105 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1a244d40-fd9e-4c90-a2cf-a0ec5d714037 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:36.790686 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1a244d40-fd9e-4c90-a2cf-a0ec5d714037 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:36.797431 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a244d40-fd9e-4c90-a2cf-a0ec5d714037 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:36.797881 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a244d40-fd9e-4c90-a2cf-a0ec5d714037 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:36.798660 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a244d40-fd9e-4c90-a2cf-a0ec5d714037 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:36.799099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a244d40-fd9e-4c90-a2cf-a0ec5d714037 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:36.823740 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1a244d40-fd9e-4c90-a2cf-a0ec5d714037 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:21:37.346736 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1a244d40-fd9e-4c90-a2cf-a0ec5d714037 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "DELETE /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 204 len: 0 microversion: 2.20 time: 0.560368 Nov 23 04:21:37.347348 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 496/934] 10.222.0.54 () {60 vars in 1279 bytes} [Tue Nov 23 04:21:36 2021] DELETE /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 04:21:37.355235 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e13ff02c-e260-4ea4-afcf-503d34e1c1c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:37.355920 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e13ff02c-e260-4ea4-afcf-503d34e1c1c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:37.362549 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e13ff02c-e260-4ea4-afcf-503d34e1c1c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:37.376016 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e13ff02c-e260-4ea4-afcf-503d34e1c1c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:37.376016 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e13ff02c-e260-4ea4-afcf-503d34e1c1c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:37.376016 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e13ff02c-e260-4ea4-afcf-503d34e1c1c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:37.495610 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e13ff02c-e260-4ea4-afcf-503d34e1c1c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:37.503593 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e13ff02c-e260-4ea4-afcf-503d34e1c1c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:37.505099 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e13ff02c-e260-4ea4-afcf-503d34e1c1c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:37.506231 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e13ff02c-e260-4ea4-afcf-503d34e1c1c8 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.154762 Nov 23 04:21:37.506791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 439/935] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:21:37 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:21:38.525173 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6f233503-9252-481e-b0ba-27df387a43b7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:38.525964 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6f233503-9252-481e-b0ba-27df387a43b7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:38.533105 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f233503-9252-481e-b0ba-27df387a43b7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:38.538521 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f233503-9252-481e-b0ba-27df387a43b7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:38.538521 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f233503-9252-481e-b0ba-27df387a43b7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:38.538521 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f233503-9252-481e-b0ba-27df387a43b7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:38.668048 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6f233503-9252-481e-b0ba-27df387a43b7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:38.675927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6f233503-9252-481e-b0ba-27df387a43b7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:38.677418 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6f233503-9252-481e-b0ba-27df387a43b7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:38.678567 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6f233503-9252-481e-b0ba-27df387a43b7 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1724 microversion: 2.20 time: 0.157522 Nov 23 04:21:38.679124 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 497/936] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:21:38 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:21:39.701051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7f3e4529-321c-4a55-b7fb-04b63c8994bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:39.701051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7f3e4529-321c-4a55-b7fb-04b63c8994bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:39.703956 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7f3e4529-321c-4a55-b7fb-04b63c8994bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:39.704414 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7f3e4529-321c-4a55-b7fb-04b63c8994bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:39.705208 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7f3e4529-321c-4a55-b7fb-04b63c8994bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:39.705646 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7f3e4529-321c-4a55-b7fb-04b63c8994bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:39.809847 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7f3e4529-321c-4a55-b7fb-04b63c8994bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:39.818623 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7f3e4529-321c-4a55-b7fb-04b63c8994bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:39.820198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7f3e4529-321c-4a55-b7fb-04b63c8994bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:39.821354 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7f3e4529-321c-4a55-b7fb-04b63c8994bc tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1656 microversion: 2.20 time: 0.128567 Nov 23 04:21:39.821920 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 440/937] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:21:39 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1656 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:21:40.029649 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-805802f5-bd8a-40be-8e80-2b8d30acd462 req-7eecd72d-fde9-49cf-ab55-9f8a67dac48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2542af4-c4d5-4fc0-b86c-00df6da8fd61", "name": "network-vif-deleted", "tag": "ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:21:40.031310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:21:40.031310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:21:40.038950 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-805802f5-bd8a-40be-8e80-2b8d30acd462 req-7eecd72d-fde9-49cf-ab55-9f8a67dac48b service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:40.042666 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-805802f5-bd8a-40be-8e80-2b8d30acd462 req-7eecd72d-fde9-49cf-ab55-9f8a67dac48b service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:40.050697 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-805802f5-bd8a-40be-8e80-2b8d30acd462 req-7eecd72d-fde9-49cf-ab55-9f8a67dac48b service nova] Creating event network-vif-deleted:ac6c97b5-f00d-4bed-9cc8-cd5bb12c9673 for instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 on hv-cinder-76845 Nov 23 04:21:40.056034 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-805802f5-bd8a-40be-8e80-2b8d30acd462 req-7eecd72d-fde9-49cf-ab55-9f8a67dac48b service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030539 Nov 23 04:21:40.059417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 498/938] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:21:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:21:40.839650 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:40.841960 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:40.848668 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:40.849190 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:40.850068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:40.850604 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:40.882652 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:40.883099 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:40.883688 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lazy-loading 'fault' on Instance uuid a2542af4-c4d5-4fc0-b86c-00df6da8fd61 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:21:40.926490 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:40.934437 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:40.936281 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1009c9c7798f48f6ad891766711d0c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891dccdfaeb440dd89a185b6d130b3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:21:40.946121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-15831a7e-f845-46f7-9b5c-9deb00713145 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 200 len: 1372 microversion: 2.20 time: 0.102477 Nov 23 04:21:40.946121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 441/939] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:21:40 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 23 04:21:41.957103 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c6521ef8-0c5d-481e-b275-65c4ad538cb2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:41.957725 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c6521ef8-0c5d-481e-b275-65c4ad538cb2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:41.964189 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c6521ef8-0c5d-481e-b275-65c4ad538cb2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:41.964633 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c6521ef8-0c5d-481e-b275-65c4ad538cb2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:41.965405 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c6521ef8-0c5d-481e-b275-65c4ad538cb2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:41.965836 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c6521ef8-0c5d-481e-b275-65c4ad538cb2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:41.979110 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-c6521ef8-0c5d-481e-b275-65c4ad538cb2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] HTTP exception thrown: Instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 could not be found. Nov 23 04:21:41.979720 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c6521ef8-0c5d-481e-b275-65c4ad538cb2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Returning 404 to user: Instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:21:41.980520 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c6521ef8-0c5d-481e-b275-65c4ad538cb2 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 404 len: 111 microversion: 2.20 time: 0.028029 Nov 23 04:21:41.981042 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 499/940] 10.222.0.54 () {60 vars in 1276 bytes} [Tue Nov 23 04:21:41 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 23 04:21:41.989746 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c3d9f89b-9cb1-4c22-9642-fa780113608d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '.version_select at 0x7fa7dd4fd4c0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:42.071957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c3d9f89b-9cb1-4c22-9642-fa780113608d tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152023082" status: 204 len: 0 microversion: 2.20 time: 0.085808 Nov 23 04:21:42.072530 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 442/941] 10.222.0.54 () {60 vars in 1261 bytes} [Tue Nov 23 04:21:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1152023082 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 23 04:21:44.105371 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dc5a4733-c9e3-4f14-8ae4-2ceb4bb59276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:44.105864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dc5a4733-c9e3-4f14-8ae4-2ceb4bb59276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:44.112206 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc5a4733-c9e3-4f14-8ae4-2ceb4bb59276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:44.112649 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc5a4733-c9e3-4f14-8ae4-2ceb4bb59276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:44.113436 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc5a4733-c9e3-4f14-8ae4-2ceb4bb59276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:44.113848 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc5a4733-c9e3-4f14-8ae4-2ceb4bb59276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:44.127285 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-dc5a4733-c9e3-4f14-8ae4-2ceb4bb59276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] HTTP exception thrown: Instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 could not be found. Nov 23 04:21:44.127860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dc5a4733-c9e3-4f14-8ae4-2ceb4bb59276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Returning 404 to user: Instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:21:44.128649 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dc5a4733-c9e3-4f14-8ae4-2ceb4bb59276 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "DELETE /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 404 len: 111 microversion: 2.1 time: 0.026904 Nov 23 04:21:44.129164 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 500/942] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:21:44 2021] DELETE /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:21:44.137223 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3ec61cd1-4170-4dc4-a1e8-4dce2f038727 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:44.137831 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3ec61cd1-4170-4dc4-a1e8-4dce2f038727 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: a2542af4-c4d5-4fc0-b86c-00df6da8fd61] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:44.144553 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3ec61cd1-4170-4dc4-a1e8-4dce2f038727 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:44.145002 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3ec61cd1-4170-4dc4-a1e8-4dce2f038727 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:44.145778 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3ec61cd1-4170-4dc4-a1e8-4dce2f038727 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:44.146214 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3ec61cd1-4170-4dc4-a1e8-4dce2f038727 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:44.159442 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-3ec61cd1-4170-4dc4-a1e8-4dce2f038727 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] HTTP exception thrown: Instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 could not be found. Nov 23 04:21:44.160281 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3ec61cd1-4170-4dc4-a1e8-4dce2f038727 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Returning 404 to user: Instance a2542af4-c4d5-4fc0-b86c-00df6da8fd61 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:21:44.161101 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3ec61cd1-4170-4dc4-a1e8-4dce2f038727 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61" status: 404 len: 111 microversion: 2.1 time: 0.028027 Nov 23 04:21:44.161626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 443/943] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:44 2021] GET /compute/v2.1/servers/a2542af4-c4d5-4fc0-b86c-00df6da8fd61 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:21:45.417894 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-580858a3-35ae-4715-a18f-497a23874f82 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:45.418366 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-580858a3-35ae-4715-a18f-497a23874f82 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:45.424910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-580858a3-35ae-4715-a18f-497a23874f82 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:45.425356 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-580858a3-35ae-4715-a18f-497a23874f82 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:45.426128 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-580858a3-35ae-4715-a18f-497a23874f82 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:45.426558 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-580858a3-35ae-4715-a18f-497a23874f82 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:45.440471 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-580858a3-35ae-4715-a18f-497a23874f82 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] HTTP exception thrown: Instance 8c13d4db-587d-4d4e-b8cc-23632d768572 could not be found. Nov 23 04:21:45.441039 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-580858a3-35ae-4715-a18f-497a23874f82 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Returning 404 to user: Instance 8c13d4db-587d-4d4e-b8cc-23632d768572 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:21:45.441839 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-580858a3-35ae-4715-a18f-497a23874f82 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "DELETE /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 404 len: 111 microversion: 2.1 time: 0.027650 Nov 23 04:21:45.442386 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 501/944] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:21:45 2021] DELETE /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:21:45.449967 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-eb3e5489-5776-4026-b47c-17fee9ab3fe6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:21:45.450572 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-eb3e5489-5776-4026-b47c-17fee9ab3fe6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] [instance: 8c13d4db-587d-4d4e-b8cc-23632d768572] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:21:45.457118 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb3e5489-5776-4026-b47c-17fee9ab3fe6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:45.457563 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb3e5489-5776-4026-b47c-17fee9ab3fe6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:45.458330 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb3e5489-5776-4026-b47c-17fee9ab3fe6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:45.458760 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-eb3e5489-5776-4026-b47c-17fee9ab3fe6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:45.471938 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-eb3e5489-5776-4026-b47c-17fee9ab3fe6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] HTTP exception thrown: Instance 8c13d4db-587d-4d4e-b8cc-23632d768572 could not be found. Nov 23 04:21:45.472509 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-eb3e5489-5776-4026-b47c-17fee9ab3fe6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] Returning 404 to user: Instance 8c13d4db-587d-4d4e-b8cc-23632d768572 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:21:45.473315 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-eb3e5489-5776-4026-b47c-17fee9ab3fe6 tempest-AttachVolumeShelveTestJSON-1734929509 tempest-AttachVolumeShelveTestJSON-1734929509-project] 10.222.0.54 "GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572" status: 404 len: 111 microversion: 2.1 time: 0.026980 Nov 23 04:21:45.473825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 444/945] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:21:45 2021] GET /compute/v2.1/servers/8c13d4db-587d-4d4e-b8cc-23632d768572 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:21:56.401432 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-cdcb83b4-99f9-41f0-98bf-24aa086bc669 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'create', calling method: .version_select at 0x7fa7dd6cd700>, body: {"keypair": {"name": "tempest-keypair-1764092527"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:21:56.415468 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-cdcb83b4-99f9-41f0-98bf-24aa086bc669 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:21:56.419166 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-cdcb83b4-99f9-41f0-98bf-24aa086bc669 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for user ca8923a30e7b4b6b9b3c2eef472c2117 and project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:21:57.093809 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-cdcb83b4-99f9-41f0-98bf-24aa086bc669 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:21:57.099136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-cdcb83b4-99f9-41f0-98bf-24aa086bc669 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for user ca8923a30e7b4b6b9b3c2eef472c2117 and project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'key_pairs'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:21:57.114008 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-cdcb83b4-99f9-41f0-98bf-24aa086bc669 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.829680 Nov 23 04:21:57.114632 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 502/946] 10.222.0.54 () {60 vars in 1157 bytes} [Tue Nov 23 04:21:56 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:21:59.301055 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1291718395", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d75cfc86-e875-4aa3-9237-5714df0b6f5c"}], "security_groups": [{"name": "tempest-securitygroup--580243950"}], "key_name": "tempest-keypair-1764092527", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:21:59.406704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.network.neutron [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] validate_networks() for [('d75cfc86-e875-4aa3-9237-5714df0b6f5c', None, None, None, None, None)] {{(pid=116837) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:21:59.819351 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Flavor limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:21:59.819768 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Image limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:21:59.820260 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Flavor pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:21:59.820662 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Image pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:21:59.821089 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:21:59.829995 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:59.831240 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:59.832230 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:21:59.832661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:21:59.850050 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:21:59.854073 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for user ca8923a30e7b4b6b9b3c2eef472c2117 and project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:21:59.864475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Going to run 1 instances... {{(pid=116837) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:21:59.866770 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:22:00.017169 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-912b4c89-cfc7-47bb-aa28-23dbf3a0ef64 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.720931 Nov 23 04:22:00.018522 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 445/947] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:21:59 2021] POST /compute/v2.1/servers => generated 401 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:22:00.029916 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a7f2c02f-dc28-4392-9f93-80257188f3ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:00.030630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a7f2c02f-dc28-4392-9f93-80257188f3ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:00.085676 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a7f2c02f-dc28-4392-9f93-80257188f3ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:00.092647 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a7f2c02f-dc28-4392-9f93-80257188f3ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1238 microversion: 2.1 time: 0.067707 Nov 23 04:22:00.102152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 503/948] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:00 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:01.110229 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-285bc1c0-c2f7-4c97-b6b7-459c2a5d5873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:01.110834 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-285bc1c0-c2f7-4c97-b6b7-459c2a5d5873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:01.117183 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-285bc1c0-c2f7-4c97-b6b7-459c2a5d5873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:01.117624 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-285bc1c0-c2f7-4c97-b6b7-459c2a5d5873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:01.118393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-285bc1c0-c2f7-4c97-b6b7-459c2a5d5873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:01.118824 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-285bc1c0-c2f7-4c97-b6b7-459c2a5d5873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:01.178637 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-285bc1c0-c2f7-4c97-b6b7-459c2a5d5873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:01.186013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-285bc1c0-c2f7-4c97-b6b7-459c2a5d5873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1242 microversion: 2.1 time: 0.079988 Nov 23 04:22:01.186705 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 446/949] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:01 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:02.203366 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b7811b02-5f7d-4135-92e9-ceb0f9795681 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:02.204752 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b7811b02-5f7d-4135-92e9-ceb0f9795681 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:02.213722 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b7811b02-5f7d-4135-92e9-ceb0f9795681 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:02.214451 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b7811b02-5f7d-4135-92e9-ceb0f9795681 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:02.215465 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b7811b02-5f7d-4135-92e9-ceb0f9795681 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:02.216318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b7811b02-5f7d-4135-92e9-ceb0f9795681 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:02.285238 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b7811b02-5f7d-4135-92e9-ceb0f9795681 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:02.292605 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b7811b02-5f7d-4135-92e9-ceb0f9795681 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1298 microversion: 2.1 time: 0.092972 Nov 23 04:22:02.293179 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 504/950] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:02 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:03.310132 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5bb69030-eace-4f22-bfda-24915b19aa38 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:03.310745 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5bb69030-eace-4f22-bfda-24915b19aa38 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:03.316982 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bb69030-eace-4f22-bfda-24915b19aa38 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:03.317420 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bb69030-eace-4f22-bfda-24915b19aa38 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:03.318223 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bb69030-eace-4f22-bfda-24915b19aa38 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:03.318642 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bb69030-eace-4f22-bfda-24915b19aa38 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:03.529299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-5bb69030-eace-4f22-bfda-24915b19aa38 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:03.537672 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5bb69030-eace-4f22-bfda-24915b19aa38 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1363 microversion: 2.1 time: 0.231143 Nov 23 04:22:03.538236 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 447/951] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:03 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:03.907575 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-a43920bb-6f0d-40e6-bb7a-1de2e1fd823a req-a95e859b-7cea-4265-8da6-7ad8e49edecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50329b3a-4863-4a29-92f9-e05c525f1435", "tag": "0429849c-9408-4787-ae74-907d8a990dda"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:03.907575 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:22:03.907575 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:22:03.911924 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-a43920bb-6f0d-40e6-bb7a-1de2e1fd823a req-a95e859b-7cea-4265-8da6-7ad8e49edecd service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:03.912373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-a43920bb-6f0d-40e6-bb7a-1de2e1fd823a req-a95e859b-7cea-4265-8da6-7ad8e49edecd service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:03.924361 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-a43920bb-6f0d-40e6-bb7a-1de2e1fd823a req-a95e859b-7cea-4265-8da6-7ad8e49edecd service nova] Creating event network-changed:0429849c-9408-4787-ae74-907d8a990dda for instance 50329b3a-4863-4a29-92f9-e05c525f1435 on hv-cinder-76845 Nov 23 04:22:03.929622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-a43920bb-6f0d-40e6-bb7a-1de2e1fd823a req-a95e859b-7cea-4265-8da6-7ad8e49edecd service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033401 Nov 23 04:22:03.930233 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 505/952] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:22:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:22:04.553947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-bcfd07fb-0599-4e92-8dfc-09a8912d8529 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:04.554568 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-bcfd07fb-0599-4e92-8dfc-09a8912d8529 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:04.561078 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bcfd07fb-0599-4e92-8dfc-09a8912d8529 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:04.561526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bcfd07fb-0599-4e92-8dfc-09a8912d8529 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:04.562311 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bcfd07fb-0599-4e92-8dfc-09a8912d8529 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:04.562743 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-bcfd07fb-0599-4e92-8dfc-09a8912d8529 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:04.825628 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-bcfd07fb-0599-4e92-8dfc-09a8912d8529 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:04.833545 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-bcfd07fb-0599-4e92-8dfc-09a8912d8529 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1363 microversion: 2.1 time: 0.283284 Nov 23 04:22:04.834113 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 448/953] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:04 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:05.851651 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1c432593-e9eb-4393-92be-5744cd4c8ad8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:05.852346 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1c432593-e9eb-4393-92be-5744cd4c8ad8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:05.858369 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1c432593-e9eb-4393-92be-5744cd4c8ad8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:05.858818 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1c432593-e9eb-4393-92be-5744cd4c8ad8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:05.859628 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1c432593-e9eb-4393-92be-5744cd4c8ad8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:05.860067 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1c432593-e9eb-4393-92be-5744cd4c8ad8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:05.989004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1c432593-e9eb-4393-92be-5744cd4c8ad8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:05.996199 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1c432593-e9eb-4393-92be-5744cd4c8ad8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1363 microversion: 2.1 time: 0.148932 Nov 23 04:22:05.996754 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 506/954] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:05 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:07.013136 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f8ed5374-aa1e-4489-b7a3-0dd34307a4f5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:07.013754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f8ed5374-aa1e-4489-b7a3-0dd34307a4f5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:07.020395 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f8ed5374-aa1e-4489-b7a3-0dd34307a4f5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:07.020862 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f8ed5374-aa1e-4489-b7a3-0dd34307a4f5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:07.021621 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f8ed5374-aa1e-4489-b7a3-0dd34307a4f5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:07.022057 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f8ed5374-aa1e-4489-b7a3-0dd34307a4f5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:07.150101 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f8ed5374-aa1e-4489-b7a3-0dd34307a4f5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:07.157385 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f8ed5374-aa1e-4489-b7a3-0dd34307a4f5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1363 microversion: 2.1 time: 0.147865 Nov 23 04:22:07.157956 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 449/955] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:07 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:08.175373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3408fbc4-8e6b-4b1a-85cc-f4451ba4c5f6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:08.175977 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3408fbc4-8e6b-4b1a-85cc-f4451ba4c5f6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:08.182502 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3408fbc4-8e6b-4b1a-85cc-f4451ba4c5f6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:08.182950 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3408fbc4-8e6b-4b1a-85cc-f4451ba4c5f6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:08.183765 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3408fbc4-8e6b-4b1a-85cc-f4451ba4c5f6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:08.184195 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3408fbc4-8e6b-4b1a-85cc-f4451ba4c5f6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:08.318560 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3408fbc4-8e6b-4b1a-85cc-f4451ba4c5f6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:08.325807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3408fbc4-8e6b-4b1a-85cc-f4451ba4c5f6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1363 microversion: 2.1 time: 0.154092 Nov 23 04:22:08.326361 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 507/956] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:08 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:09.342822 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-782efc99-9ee1-4164-96a7-bf80da0a0bcb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:09.343463 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-782efc99-9ee1-4164-96a7-bf80da0a0bcb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:09.349548 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-782efc99-9ee1-4164-96a7-bf80da0a0bcb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:09.349994 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-782efc99-9ee1-4164-96a7-bf80da0a0bcb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:09.350760 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-782efc99-9ee1-4164-96a7-bf80da0a0bcb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:09.351193 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-782efc99-9ee1-4164-96a7-bf80da0a0bcb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:09.484128 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-782efc99-9ee1-4164-96a7-bf80da0a0bcb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:09.491824 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-782efc99-9ee1-4164-96a7-bf80da0a0bcb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1363 microversion: 2.1 time: 0.152830 Nov 23 04:22:09.492397 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 450/957] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:09 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:10.508313 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-177ce6ee-3a1d-4767-9b6f-f8d951b8b55d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:10.508913 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-177ce6ee-3a1d-4767-9b6f-f8d951b8b55d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:10.515174 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-177ce6ee-3a1d-4767-9b6f-f8d951b8b55d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:10.515677 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-177ce6ee-3a1d-4767-9b6f-f8d951b8b55d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:10.516507 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-177ce6ee-3a1d-4767-9b6f-f8d951b8b55d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:10.516937 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-177ce6ee-3a1d-4767-9b6f-f8d951b8b55d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:10.652514 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-177ce6ee-3a1d-4767-9b6f-f8d951b8b55d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:10.660138 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-177ce6ee-3a1d-4767-9b6f-f8d951b8b55d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1363 microversion: 2.1 time: 0.155478 Nov 23 04:22:10.660708 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 508/958] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:10 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:10.676066 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-5e6d9b30-11e5-4f14-82aa-c393a4a13f32 req-cbd60341-75a6-4235-8314-51a4f3f95eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50329b3a-4863-4a29-92f9-e05c525f1435", "name": "network-vif-plugged", "status": "completed", "tag": "0429849c-9408-4787-ae74-907d8a990dda"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:10.677718 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:22:10.677718 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:22:10.685820 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-5e6d9b30-11e5-4f14-82aa-c393a4a13f32 req-cbd60341-75a6-4235-8314-51a4f3f95eaa service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:10.686273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-5e6d9b30-11e5-4f14-82aa-c393a4a13f32 req-cbd60341-75a6-4235-8314-51a4f3f95eaa service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:10.697758 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-5e6d9b30-11e5-4f14-82aa-c393a4a13f32 req-cbd60341-75a6-4235-8314-51a4f3f95eaa service nova] Creating event network-vif-plugged:0429849c-9408-4787-ae74-907d8a990dda for instance 50329b3a-4863-4a29-92f9-e05c525f1435 on hv-cinder-76845 Nov 23 04:22:10.702651 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-5e6d9b30-11e5-4f14-82aa-c393a4a13f32 req-cbd60341-75a6-4235-8314-51a4f3f95eaa service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030645 Nov 23 04:22:10.703342 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 451/959] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:22:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:22:11.676892 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-121e2fce-2285-41d0-8327-1945ec8307d3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:11.677554 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-121e2fce-2285-41d0-8327-1945ec8307d3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:11.683876 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-121e2fce-2285-41d0-8327-1945ec8307d3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:11.684320 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-121e2fce-2285-41d0-8327-1945ec8307d3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:11.685124 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-121e2fce-2285-41d0-8327-1945ec8307d3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:11.685555 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-121e2fce-2285-41d0-8327-1945ec8307d3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:11.816577 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-121e2fce-2285-41d0-8327-1945ec8307d3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:11.823723 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-121e2fce-2285-41d0-8327-1945ec8307d3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1363 microversion: 2.1 time: 0.150735 Nov 23 04:22:11.824277 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 509/960] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:11 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:12.841879 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a01c6a55-0fbd-4e5c-8b05-6423d2074e14 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:12.891521 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a01c6a55-0fbd-4e5c-8b05-6423d2074e14 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:12.891521 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a01c6a55-0fbd-4e5c-8b05-6423d2074e14 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:12.891521 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a01c6a55-0fbd-4e5c-8b05-6423d2074e14 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:12.891521 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a01c6a55-0fbd-4e5c-8b05-6423d2074e14 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:12.891951 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a01c6a55-0fbd-4e5c-8b05-6423d2074e14 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:12.983576 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a01c6a55-0fbd-4e5c-8b05-6423d2074e14 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:12.991786 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a01c6a55-0fbd-4e5c-8b05-6423d2074e14 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1549 microversion: 2.1 time: 0.154448 Nov 23 04:22:12.992351 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 452/961] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:12 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:22:13.007877 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-eafa92e8-ee34-4d0c-9f5e-462ad057f223 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:13.008392 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-eafa92e8-ee34-4d0c-9f5e-462ad057f223 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:13.014510 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eafa92e8-ee34-4d0c-9f5e-462ad057f223 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:13.014957 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eafa92e8-ee34-4d0c-9f5e-462ad057f223 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:13.015839 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eafa92e8-ee34-4d0c-9f5e-462ad057f223 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:13.016282 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eafa92e8-ee34-4d0c-9f5e-462ad057f223 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:13.093510 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-eafa92e8-ee34-4d0c-9f5e-462ad057f223 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089171 Nov 23 04:22:13.094104 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 510/962] 10.222.0.54 () {58 vars in 1274 bytes} [Tue Nov 23 04:22:13 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:22:14.114166 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b485b932-6059-4383-a69b-c82c3b5c2aca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:14.119847 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-499b4090-61e9-4f13-a1c3-9b5dbb259fd0 req-d089d9ae-385f-42b1-9dd5-945ff51436d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50329b3a-4863-4a29-92f9-e05c525f1435", "tag": "0429849c-9408-4787-ae74-907d8a990dda"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:14.120818 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b485b932-6059-4383-a69b-c82c3b5c2aca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:14.124949 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:22:14.124949 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:22:14.129016 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b485b932-6059-4383-a69b-c82c3b5c2aca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:14.130142 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b485b932-6059-4383-a69b-c82c3b5c2aca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:14.130453 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b485b932-6059-4383-a69b-c82c3b5c2aca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:14.130952 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b485b932-6059-4383-a69b-c82c3b5c2aca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:14.136571 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-499b4090-61e9-4f13-a1c3-9b5dbb259fd0 req-d089d9ae-385f-42b1-9dd5-945ff51436d1 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:14.136738 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-499b4090-61e9-4f13-a1c3-9b5dbb259fd0 req-d089d9ae-385f-42b1-9dd5-945ff51436d1 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:14.148621 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-499b4090-61e9-4f13-a1c3-9b5dbb259fd0 req-d089d9ae-385f-42b1-9dd5-945ff51436d1 service nova] Creating event network-changed:0429849c-9408-4787-ae74-907d8a990dda for instance 50329b3a-4863-4a29-92f9-e05c525f1435 on hv-cinder-76845 Nov 23 04:22:14.153721 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-499b4090-61e9-4f13-a1c3-9b5dbb259fd0 req-d089d9ae-385f-42b1-9dd5-945ff51436d1 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037782 Nov 23 04:22:14.154724 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 511/963] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:22:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:22:14.234910 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b485b932-6059-4383-a69b-c82c3b5c2aca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 14 microversion: 2.1 time: 0.124829 Nov 23 04:22:14.235651 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 453/964] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:14 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:22:15.246489 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-47d27c59-c10c-4d0a-9b08-1d59a3a279ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:15.247524 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-47d27c59-c10c-4d0a-9b08-1d59a3a279ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:15.254779 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47d27c59-c10c-4d0a-9b08-1d59a3a279ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:15.255324 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47d27c59-c10c-4d0a-9b08-1d59a3a279ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:15.256051 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47d27c59-c10c-4d0a-9b08-1d59a3a279ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:15.256480 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47d27c59-c10c-4d0a-9b08-1d59a3a279ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:15.342417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-47d27c59-c10c-4d0a-9b08-1d59a3a279ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 14 microversion: 2.1 time: 0.099784 Nov 23 04:22:15.343052 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 512/965] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:15 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:22:16.353737 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8c07257a-894f-4437-8c38-99138712d44c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:16.354723 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8c07257a-894f-4437-8c38-99138712d44c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:16.362068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8c07257a-894f-4437-8c38-99138712d44c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:16.362512 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8c07257a-894f-4437-8c38-99138712d44c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:16.363334 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8c07257a-894f-4437-8c38-99138712d44c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:16.363769 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8c07257a-894f-4437-8c38-99138712d44c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:16.443601 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8c07257a-894f-4437-8c38-99138712d44c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 14 microversion: 2.1 time: 0.093742 Nov 23 04:22:16.444209 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 454/966] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:16 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 04:22:17.454211 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fc0da3b1-e20c-4f53-be54-826f6071400e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:17.455250 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fc0da3b1-e20c-4f53-be54-826f6071400e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:17.462582 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc0da3b1-e20c-4f53-be54-826f6071400e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:17.463031 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc0da3b1-e20c-4f53-be54-826f6071400e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:17.463888 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc0da3b1-e20c-4f53-be54-826f6071400e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:17.464318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc0da3b1-e20c-4f53-be54-826f6071400e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:17.549284 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fc0da3b1-e20c-4f53-be54-826f6071400e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 14 microversion: 2.1 time: 0.098811 Nov 23 04:22:17.549890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 513/967] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:17 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:22:18.560189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e9123291-77bf-453e-9c6e-728eeef67493 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:18.561184 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e9123291-77bf-453e-9c6e-728eeef67493 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:18.568074 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e9123291-77bf-453e-9c6e-728eeef67493 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:18.568535 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e9123291-77bf-453e-9c6e-728eeef67493 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:18.569313 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e9123291-77bf-453e-9c6e-728eeef67493 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:18.569751 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e9123291-77bf-453e-9c6e-728eeef67493 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:18.651913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e9123291-77bf-453e-9c6e-728eeef67493 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 14 microversion: 2.1 time: 0.095494 Nov 23 04:22:18.652576 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 455/968] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:18 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:22:19.664201 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b4e23af1-035b-432a-8c59-0d97bf379040 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:19.665268 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b4e23af1-035b-432a-8c59-0d97bf379040 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:19.672249 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b4e23af1-035b-432a-8c59-0d97bf379040 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:19.672690 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b4e23af1-035b-432a-8c59-0d97bf379040 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:19.673462 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b4e23af1-035b-432a-8c59-0d97bf379040 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:19.674553 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b4e23af1-035b-432a-8c59-0d97bf379040 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:19.753187 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b4e23af1-035b-432a-8c59-0d97bf379040 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 14 microversion: 2.1 time: 0.092312 Nov 23 04:22:19.753955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 514/969] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:19 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:22:20.770895 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5866848a-5be6-4c45-ba30-9d98926baa0c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:20.771983 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5866848a-5be6-4c45-ba30-9d98926baa0c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:20.778752 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5866848a-5be6-4c45-ba30-9d98926baa0c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:20.779201 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5866848a-5be6-4c45-ba30-9d98926baa0c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:20.779993 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5866848a-5be6-4c45-ba30-9d98926baa0c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:20.780425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5866848a-5be6-4c45-ba30-9d98926baa0c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:20.859645 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5866848a-5be6-4c45-ba30-9d98926baa0c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 14 microversion: 2.1 time: 0.092652 Nov 23 04:22:20.860425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 456/970] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:20 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:22:21.871947 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c942a823-9c97-4b7b-bfba-1a016c3526d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:21.872994 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c942a823-9c97-4b7b-bfba-1a016c3526d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:21.879976 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c942a823-9c97-4b7b-bfba-1a016c3526d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:21.880424 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c942a823-9c97-4b7b-bfba-1a016c3526d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:21.881203 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c942a823-9c97-4b7b-bfba-1a016c3526d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:21.881647 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c942a823-9c97-4b7b-bfba-1a016c3526d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:21.968542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c942a823-9c97-4b7b-bfba-1a016c3526d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 14 microversion: 2.1 time: 0.100566 Nov 23 04:22:21.969066 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 515/971] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:21 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:22:22.979823 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5bb63f08-c02a-44b4-aebb-1c71647d61de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:22.980792 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5bb63f08-c02a-44b4-aebb-1c71647d61de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:22.988607 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bb63f08-c02a-44b4-aebb-1c71647d61de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:22.989076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bb63f08-c02a-44b4-aebb-1c71647d61de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:22.989868 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bb63f08-c02a-44b4-aebb-1c71647d61de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:22.990311 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5bb63f08-c02a-44b4-aebb-1c71647d61de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:23.070621 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5bb63f08-c02a-44b4-aebb-1c71647d61de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 14 microversion: 2.1 time: 0.094814 Nov 23 04:22:23.071240 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 457/972] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:22 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:22:24.082693 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-943e95fb-c165-4531-aef5-b0ef276e2b7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:24.083720 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-943e95fb-c165-4531-aef5-b0ef276e2b7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:24.090607 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-943e95fb-c165-4531-aef5-b0ef276e2b7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:24.091064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-943e95fb-c165-4531-aef5-b0ef276e2b7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:24.091874 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-943e95fb-c165-4531-aef5-b0ef276e2b7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:24.092316 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-943e95fb-c165-4531-aef5-b0ef276e2b7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:24.194272 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-943e95fb-c165-4531-aef5-b0ef276e2b7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 5711 microversion: 2.1 time: 0.116386 Nov 23 04:22:24.195092 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 516/973] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:24 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 5711 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:25.205371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a2121fa4-5127-4bab-9ebf-1d2372e1c8ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:25.206392 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a2121fa4-5127-4bab-9ebf-1d2372e1c8ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:25.213984 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a2121fa4-5127-4bab-9ebf-1d2372e1c8ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:25.214481 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a2121fa4-5127-4bab-9ebf-1d2372e1c8ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:25.215267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a2121fa4-5127-4bab-9ebf-1d2372e1c8ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:25.215714 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a2121fa4-5127-4bab-9ebf-1d2372e1c8ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:25.306217 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a2121fa4-5127-4bab-9ebf-1d2372e1c8ce tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 14986 microversion: 2.1 time: 0.104578 Nov 23 04:22:25.306773 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 458/974] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:25 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 14986 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:26.318705 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a177afb1-06f8-4af4-b2d1-749a624f9227 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:26.319727 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a177afb1-06f8-4af4-b2d1-749a624f9227 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:26.326588 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a177afb1-06f8-4af4-b2d1-749a624f9227 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:26.327037 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a177afb1-06f8-4af4-b2d1-749a624f9227 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:26.327845 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a177afb1-06f8-4af4-b2d1-749a624f9227 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:26.328280 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a177afb1-06f8-4af4-b2d1-749a624f9227 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:26.422101 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a177afb1-06f8-4af4-b2d1-749a624f9227 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 18356 microversion: 2.1 time: 0.107900 Nov 23 04:22:26.422719 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 517/975] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:26 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 18356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:27.434149 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b93550b7-c588-4bb0-b5ea-635b58defa79 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:27.435176 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b93550b7-c588-4bb0-b5ea-635b58defa79 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:27.442767 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b93550b7-c588-4bb0-b5ea-635b58defa79 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:27.443305 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b93550b7-c588-4bb0-b5ea-635b58defa79 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:27.444075 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b93550b7-c588-4bb0-b5ea-635b58defa79 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:27.444507 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b93550b7-c588-4bb0-b5ea-635b58defa79 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:27.541902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b93550b7-c588-4bb0-b5ea-635b58defa79 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 19342 microversion: 2.1 time: 0.111705 Nov 23 04:22:27.542740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 459/976] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:27 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 19342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:28.554508 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-80edd3ac-8229-4385-9dce-ee42286b9c22 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:28.555526 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-80edd3ac-8229-4385-9dce-ee42286b9c22 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:28.562366 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-80edd3ac-8229-4385-9dce-ee42286b9c22 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:28.562817 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-80edd3ac-8229-4385-9dce-ee42286b9c22 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:28.563627 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-80edd3ac-8229-4385-9dce-ee42286b9c22 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:28.564063 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-80edd3ac-8229-4385-9dce-ee42286b9c22 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:28.653971 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-80edd3ac-8229-4385-9dce-ee42286b9c22 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 22021 microversion: 2.1 time: 0.103996 Nov 23 04:22:28.654594 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 518/977] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:28 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 22021 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:29.665638 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-49acd44b-bb77-42f0-83b7-fcd11788b834 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:29.666631 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-49acd44b-bb77-42f0-83b7-fcd11788b834 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:29.673482 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-49acd44b-bb77-42f0-83b7-fcd11788b834 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:29.673929 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-49acd44b-bb77-42f0-83b7-fcd11788b834 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:29.674695 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-49acd44b-bb77-42f0-83b7-fcd11788b834 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:29.675128 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-49acd44b-bb77-42f0-83b7-fcd11788b834 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:29.768442 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-49acd44b-bb77-42f0-83b7-fcd11788b834 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 23235 microversion: 2.1 time: 0.106635 Nov 23 04:22:29.769130 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 460/978] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:29 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 23235 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:30.780537 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-63ac5718-25d1-4542-aa9a-0a2b2542c202 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:30.781463 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-63ac5718-25d1-4542-aa9a-0a2b2542c202 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:30.788574 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-63ac5718-25d1-4542-aa9a-0a2b2542c202 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:30.789028 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-63ac5718-25d1-4542-aa9a-0a2b2542c202 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:30.789814 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-63ac5718-25d1-4542-aa9a-0a2b2542c202 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:30.790252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-63ac5718-25d1-4542-aa9a-0a2b2542c202 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:30.886022 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-63ac5718-25d1-4542-aa9a-0a2b2542c202 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 24991 microversion: 2.1 time: 0.109396 Nov 23 04:22:30.886712 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 519/979] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:30 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 24991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:31.898393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ab1a0340-38fc-4b70-8721-0b19c758403b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:31.899417 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ab1a0340-38fc-4b70-8721-0b19c758403b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:31.906294 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ab1a0340-38fc-4b70-8721-0b19c758403b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:31.906745 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ab1a0340-38fc-4b70-8721-0b19c758403b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:31.907554 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ab1a0340-38fc-4b70-8721-0b19c758403b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:31.907997 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ab1a0340-38fc-4b70-8721-0b19c758403b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:31.998991 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ab1a0340-38fc-4b70-8721-0b19c758403b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 26586 microversion: 2.1 time: 0.104956 Nov 23 04:22:31.999666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 461/980] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:31 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 26586 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:33.010517 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e5415c95-10f8-4887-aa44-6e03d36a4ed2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:33.011544 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e5415c95-10f8-4887-aa44-6e03d36a4ed2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:33.018315 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e5415c95-10f8-4887-aa44-6e03d36a4ed2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:33.018760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e5415c95-10f8-4887-aa44-6e03d36a4ed2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:33.019564 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e5415c95-10f8-4887-aa44-6e03d36a4ed2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:33.019994 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e5415c95-10f8-4887-aa44-6e03d36a4ed2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:33.123362 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e5415c95-10f8-4887-aa44-6e03d36a4ed2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 27642 microversion: 2.1 time: 0.116656 Nov 23 04:22:33.123992 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 520/981] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:33 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 27642 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:22:34.134412 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-dff82ef4-6cbc-402a-af0c-3441ff585fff tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:34.135440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-dff82ef4-6cbc-402a-af0c-3441ff585fff tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:34.142291 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dff82ef4-6cbc-402a-af0c-3441ff585fff tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:34.142738 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dff82ef4-6cbc-402a-af0c-3441ff585fff tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:34.143535 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dff82ef4-6cbc-402a-af0c-3441ff585fff tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:34.143962 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dff82ef4-6cbc-402a-af0c-3441ff585fff tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:34.247247 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-dff82ef4-6cbc-402a-af0c-3441ff585fff tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 28080 microversion: 2.1 time: 0.116669 Nov 23 04:22:34.248146 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 462/982] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:34 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 28080 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:35.258321 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e507ad51-73ff-4e1a-aa9c-23c590752d11 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:35.259382 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e507ad51-73ff-4e1a-aa9c-23c590752d11 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:35.266155 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e507ad51-73ff-4e1a-aa9c-23c590752d11 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:35.266603 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e507ad51-73ff-4e1a-aa9c-23c590752d11 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:35.267426 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e507ad51-73ff-4e1a-aa9c-23c590752d11 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:35.267863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e507ad51-73ff-4e1a-aa9c-23c590752d11 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:35.362652 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e507ad51-73ff-4e1a-aa9c-23c590752d11 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 28207 microversion: 2.1 time: 0.108231 Nov 23 04:22:35.363304 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 521/983] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:35 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 28207 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:36.375529 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a188d868-80e4-4162-8875-be79ef988777 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:36.376536 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a188d868-80e4-4162-8875-be79ef988777 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:36.384069 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a188d868-80e4-4162-8875-be79ef988777 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:36.384514 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a188d868-80e4-4162-8875-be79ef988777 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:36.385315 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a188d868-80e4-4162-8875-be79ef988777 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:36.385747 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a188d868-80e4-4162-8875-be79ef988777 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:36.474762 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a188d868-80e4-4162-8875-be79ef988777 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 28498 microversion: 2.1 time: 0.103162 Nov 23 04:22:36.475623 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 463/984] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:36 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 28498 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:37.488241 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-27c8d90f-77c6-455f-8d12-3fec1a7e8e8d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:37.489219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-27c8d90f-77c6-455f-8d12-3fec1a7e8e8d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:37.496272 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27c8d90f-77c6-455f-8d12-3fec1a7e8e8d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:37.496726 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27c8d90f-77c6-455f-8d12-3fec1a7e8e8d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:37.497546 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27c8d90f-77c6-455f-8d12-3fec1a7e8e8d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:37.498009 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27c8d90f-77c6-455f-8d12-3fec1a7e8e8d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:37.589571 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-27c8d90f-77c6-455f-8d12-3fec1a7e8e8d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 28666 microversion: 2.1 time: 0.105157 Nov 23 04:22:37.590202 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 522/985] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:37 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 28666 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:38.601740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b17952bb-d89d-49b7-b2e6-3126ba059cf6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:38.602732 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b17952bb-d89d-49b7-b2e6-3126ba059cf6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:38.609586 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b17952bb-d89d-49b7-b2e6-3126ba059cf6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:38.610033 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b17952bb-d89d-49b7-b2e6-3126ba059cf6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:38.610809 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b17952bb-d89d-49b7-b2e6-3126ba059cf6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:38.611268 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b17952bb-d89d-49b7-b2e6-3126ba059cf6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:38.693123 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b17952bb-d89d-49b7-b2e6-3126ba059cf6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 28666 microversion: 2.1 time: 0.096208 Nov 23 04:22:38.693832 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 464/986] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:38 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 28666 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:39.705518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-cf6ad2e4-8417-482e-b515-95df515e51be tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:39.706573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-cf6ad2e4-8417-482e-b515-95df515e51be tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:39.713790 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cf6ad2e4-8417-482e-b515-95df515e51be tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:39.715990 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cf6ad2e4-8417-482e-b515-95df515e51be tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:39.715990 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cf6ad2e4-8417-482e-b515-95df515e51be tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:39.715990 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cf6ad2e4-8417-482e-b515-95df515e51be tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:39.812476 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-cf6ad2e4-8417-482e-b515-95df515e51be tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 28666 microversion: 2.1 time: 0.110920 Nov 23 04:22:39.813112 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 523/987] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:39 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 28666 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:40.825094 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f45cab5c-3488-4e8f-8653-5b77ad63fe4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:40.826141 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f45cab5c-3488-4e8f-8653-5b77ad63fe4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:40.832917 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f45cab5c-3488-4e8f-8653-5b77ad63fe4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:40.833361 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f45cab5c-3488-4e8f-8653-5b77ad63fe4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:40.834124 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f45cab5c-3488-4e8f-8653-5b77ad63fe4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:40.834553 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f45cab5c-3488-4e8f-8653-5b77ad63fe4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:40.929244 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f45cab5c-3488-4e8f-8653-5b77ad63fe4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 28802 microversion: 2.1 time: 0.107446 Nov 23 04:22:40.929849 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 465/988] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:40 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 28802 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:41.941283 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9b42e3d6-6789-46aa-9942-f84938581cb0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:41.942203 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9b42e3d6-6789-46aa-9942-f84938581cb0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:41.949177 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9b42e3d6-6789-46aa-9942-f84938581cb0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:41.949627 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9b42e3d6-6789-46aa-9942-f84938581cb0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:41.950401 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9b42e3d6-6789-46aa-9942-f84938581cb0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:41.950836 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9b42e3d6-6789-46aa-9942-f84938581cb0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:42.042233 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9b42e3d6-6789-46aa-9942-f84938581cb0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 31047 microversion: 2.1 time: 0.104930 Nov 23 04:22:42.042858 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 524/989] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:41 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 31047 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:43.054089 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-cc0fb172-ae86-4832-9d27-4c50c440bb74 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:43.055095 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-cc0fb172-ae86-4832-9d27-4c50c440bb74 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:43.062832 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc0fb172-ae86-4832-9d27-4c50c440bb74 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:43.063310 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc0fb172-ae86-4832-9d27-4c50c440bb74 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:43.064085 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc0fb172-ae86-4832-9d27-4c50c440bb74 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:43.064527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc0fb172-ae86-4832-9d27-4c50c440bb74 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:43.158839 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-cc0fb172-ae86-4832-9d27-4c50c440bb74 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 32957 microversion: 2.1 time: 0.108343 Nov 23 04:22:43.159621 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 466/990] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:43 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 32957 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:44.171653 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-321fc85d-8f9c-489b-994c-bf78bc712112 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:44.172665 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-321fc85d-8f9c-489b-994c-bf78bc712112 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:44.179492 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-321fc85d-8f9c-489b-994c-bf78bc712112 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:44.179939 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-321fc85d-8f9c-489b-994c-bf78bc712112 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:44.181461 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-321fc85d-8f9c-489b-994c-bf78bc712112 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:44.181896 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-321fc85d-8f9c-489b-994c-bf78bc712112 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:44.280662 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-321fc85d-8f9c-489b-994c-bf78bc712112 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 33937 microversion: 2.1 time: 0.112912 Nov 23 04:22:44.281598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 525/991] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:44 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 33937 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:44.742236 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-50a77330-0dbc-41e5-bc66-54d16a82fb07 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:44.742857 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-50a77330-0dbc-41e5-bc66-54d16a82fb07 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:44.750221 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50a77330-0dbc-41e5-bc66-54d16a82fb07 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:44.750673 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50a77330-0dbc-41e5-bc66-54d16a82fb07 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:44.751486 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50a77330-0dbc-41e5-bc66-54d16a82fb07 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:44.751936 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50a77330-0dbc-41e5-bc66-54d16a82fb07 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:44.775551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-50a77330-0dbc-41e5-bc66-54d16a82fb07 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lazy-loading 'flavor' on Instance uuid fe99c22a-d75b-4a5c-8800-6a65d64ded71 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:22:45.040717 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-50a77330-0dbc-41e5-bc66-54d16a82fb07 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "POST /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71/action" status: 202 len: 0 microversion: 2.1 time: 0.301784 Nov 23 04:22:45.041308 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 467/992] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:44 2021] POST /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:22:45.050159 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-76f265f4-94c3-462d-9a6e-9898d88d75fe tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:45.050959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-76f265f4-94c3-462d-9a6e-9898d88d75fe tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:45.058312 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76f265f4-94c3-462d-9a6e-9898d88d75fe tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:45.058753 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76f265f4-94c3-462d-9a6e-9898d88d75fe tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:45.059573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76f265f4-94c3-462d-9a6e-9898d88d75fe tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:45.059999 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76f265f4-94c3-462d-9a6e-9898d88d75fe tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:45.195931 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-76f265f4-94c3-462d-9a6e-9898d88d75fe tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:45.203237 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-76f265f4-94c3-462d-9a6e-9898d88d75fe tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.157296 Nov 23 04:22:45.203809 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 526/993] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:45 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:45.294273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6d43e5b9-df7b-4213-a1e7-9477a619942c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:45.295188 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6d43e5b9-df7b-4213-a1e7-9477a619942c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:45.302135 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6d43e5b9-df7b-4213-a1e7-9477a619942c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:45.302582 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6d43e5b9-df7b-4213-a1e7-9477a619942c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:45.303419 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6d43e5b9-df7b-4213-a1e7-9477a619942c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:45.303931 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6d43e5b9-df7b-4213-a1e7-9477a619942c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:45.401604 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6d43e5b9-df7b-4213-a1e7-9477a619942c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 35109 microversion: 2.1 time: 0.112507 Nov 23 04:22:45.402267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 468/994] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:45 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 35109 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:46.221645 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-198471bb-db9b-4e8f-9d0b-0a3218846c66 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:46.222247 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-198471bb-db9b-4e8f-9d0b-0a3218846c66 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:46.228939 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-198471bb-db9b-4e8f-9d0b-0a3218846c66 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:46.229381 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-198471bb-db9b-4e8f-9d0b-0a3218846c66 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:46.230157 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-198471bb-db9b-4e8f-9d0b-0a3218846c66 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:46.230586 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-198471bb-db9b-4e8f-9d0b-0a3218846c66 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:46.365403 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-198471bb-db9b-4e8f-9d0b-0a3218846c66 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:46.373957 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-198471bb-db9b-4e8f-9d0b-0a3218846c66 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.155927 Nov 23 04:22:46.374532 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 527/995] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:46 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:46.414165 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-143995ec-8eed-4ebe-99e9-6c8db1bf72f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:46.415745 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-143995ec-8eed-4ebe-99e9-6c8db1bf72f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:46.422411 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-143995ec-8eed-4ebe-99e9-6c8db1bf72f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:46.422857 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-143995ec-8eed-4ebe-99e9-6c8db1bf72f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:46.423734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-143995ec-8eed-4ebe-99e9-6c8db1bf72f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:46.424164 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-143995ec-8eed-4ebe-99e9-6c8db1bf72f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:46.531338 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-143995ec-8eed-4ebe-99e9-6c8db1bf72f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 36314 microversion: 2.1 time: 0.121045 Nov 23 04:22:46.531994 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 469/996] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:46 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 36314 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:47.391937 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-623c7093-2440-4d0c-b96a-12efc5e91bd6 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:47.392582 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-623c7093-2440-4d0c-b96a-12efc5e91bd6 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:47.398694 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-623c7093-2440-4d0c-b96a-12efc5e91bd6 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:47.399139 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-623c7093-2440-4d0c-b96a-12efc5e91bd6 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:47.399957 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-623c7093-2440-4d0c-b96a-12efc5e91bd6 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:47.401026 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-623c7093-2440-4d0c-b96a-12efc5e91bd6 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:47.533894 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-623c7093-2440-4d0c-b96a-12efc5e91bd6 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:47.541565 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-623c7093-2440-4d0c-b96a-12efc5e91bd6 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.153329 Nov 23 04:22:47.542307 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 528/997] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:47 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:47.544418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-789dc70b-a724-4286-a3eb-ac6024f4fa18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:47.545425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-789dc70b-a724-4286-a3eb-ac6024f4fa18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:47.552272 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-789dc70b-a724-4286-a3eb-ac6024f4fa18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:47.552724 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-789dc70b-a724-4286-a3eb-ac6024f4fa18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:47.553517 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-789dc70b-a724-4286-a3eb-ac6024f4fa18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:47.553957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-789dc70b-a724-4286-a3eb-ac6024f4fa18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:47.645100 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-789dc70b-a724-4286-a3eb-ac6024f4fa18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 37828 microversion: 2.1 time: 0.105007 Nov 23 04:22:47.645821 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 470/998] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:47 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 37828 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:22:48.558860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7fbc11da-f84d-4992-960d-6e2873902d3d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:48.559498 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7fbc11da-f84d-4992-960d-6e2873902d3d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:48.565708 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7fbc11da-f84d-4992-960d-6e2873902d3d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:48.566151 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7fbc11da-f84d-4992-960d-6e2873902d3d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:48.566922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7fbc11da-f84d-4992-960d-6e2873902d3d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:48.567383 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7fbc11da-f84d-4992-960d-6e2873902d3d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:48.657634 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ee1dbaae-af10-405c-aaa2-b8c6ecc907e0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:48.658984 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ee1dbaae-af10-405c-aaa2-b8c6ecc907e0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:48.666131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ee1dbaae-af10-405c-aaa2-b8c6ecc907e0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:48.666601 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ee1dbaae-af10-405c-aaa2-b8c6ecc907e0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:48.667439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ee1dbaae-af10-405c-aaa2-b8c6ecc907e0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:48.668416 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ee1dbaae-af10-405c-aaa2-b8c6ecc907e0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:48.703434 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-7fbc11da-f84d-4992-960d-6e2873902d3d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:48.710590 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7fbc11da-f84d-4992-960d-6e2873902d3d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.155966 Nov 23 04:22:48.711155 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 529/999] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:48 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:48.765831 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ee1dbaae-af10-405c-aaa2-b8c6ecc907e0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 38201 microversion: 2.1 time: 0.112074 Nov 23 04:22:48.766480 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 471/1000] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:48 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 38201 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:49.726631 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0fbbbe2b-4d95-48f5-8f58-3e0b8a58b6b2 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:49.727252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0fbbbe2b-4d95-48f5-8f58-3e0b8a58b6b2 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:49.733708 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0fbbbe2b-4d95-48f5-8f58-3e0b8a58b6b2 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:49.734160 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0fbbbe2b-4d95-48f5-8f58-3e0b8a58b6b2 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:49.734945 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0fbbbe2b-4d95-48f5-8f58-3e0b8a58b6b2 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:49.735435 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0fbbbe2b-4d95-48f5-8f58-3e0b8a58b6b2 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:49.777907 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f2972269-fc67-4b15-a2cb-d8d33c1f14d7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:49.782202 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f2972269-fc67-4b15-a2cb-d8d33c1f14d7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:49.789829 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f2972269-fc67-4b15-a2cb-d8d33c1f14d7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:49.790281 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f2972269-fc67-4b15-a2cb-d8d33c1f14d7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:49.791071 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f2972269-fc67-4b15-a2cb-d8d33c1f14d7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:49.791538 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f2972269-fc67-4b15-a2cb-d8d33c1f14d7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:49.868955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0fbbbe2b-4d95-48f5-8f58-3e0b8a58b6b2 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:49.877373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0fbbbe2b-4d95-48f5-8f58-3e0b8a58b6b2 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.154494 Nov 23 04:22:49.877952 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 530/1001] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:49 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:49.878373 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f2972269-fc67-4b15-a2cb-d8d33c1f14d7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 38201 microversion: 2.1 time: 0.104265 Nov 23 04:22:49.879024 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 472/1002] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:49 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 38201 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:22:50.889953 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-49c043c4-0783-43ab-89f8-5b2219aede04 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:50.890903 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-49c043c4-0783-43ab-89f8-5b2219aede04 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:50.895904 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6c342a77-5200-4a85-979f-aa7fbf49b509 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:50.897099 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6c342a77-5200-4a85-979f-aa7fbf49b509 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:50.897232 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-49c043c4-0783-43ab-89f8-5b2219aede04 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:50.897576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-49c043c4-0783-43ab-89f8-5b2219aede04 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:50.898348 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-49c043c4-0783-43ab-89f8-5b2219aede04 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:50.898775 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-49c043c4-0783-43ab-89f8-5b2219aede04 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:50.903299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6c342a77-5200-4a85-979f-aa7fbf49b509 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:50.903692 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6c342a77-5200-4a85-979f-aa7fbf49b509 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:50.904531 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6c342a77-5200-4a85-979f-aa7fbf49b509 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:50.905014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6c342a77-5200-4a85-979f-aa7fbf49b509 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:51.001074 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-49c043c4-0783-43ab-89f8-5b2219aede04 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 38201 microversion: 2.1 time: 0.114754 Nov 23 04:22:51.002599 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 531/1003] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:50 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 38201 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:22:51.039141 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6c342a77-5200-4a85-979f-aa7fbf49b509 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:51.046910 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6c342a77-5200-4a85-979f-aa7fbf49b509 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.154965 Nov 23 04:22:51.047510 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 473/1004] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:50 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:52.013387 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4bd547d6-b6c8-4194-a5e2-87cd0c7bafe4 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:52.014411 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4bd547d6-b6c8-4194-a5e2-87cd0c7bafe4 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:52.021244 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4bd547d6-b6c8-4194-a5e2-87cd0c7bafe4 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:52.021695 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4bd547d6-b6c8-4194-a5e2-87cd0c7bafe4 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:52.022475 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4bd547d6-b6c8-4194-a5e2-87cd0c7bafe4 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:52.022908 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4bd547d6-b6c8-4194-a5e2-87cd0c7bafe4 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:52.063326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-18aa78ea-69b7-48bd-8656-26bd6e1b5b49 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:52.063940 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-18aa78ea-69b7-48bd-8656-26bd6e1b5b49 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:52.070102 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-18aa78ea-69b7-48bd-8656-26bd6e1b5b49 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:52.070551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-18aa78ea-69b7-48bd-8656-26bd6e1b5b49 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:52.071359 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-18aa78ea-69b7-48bd-8656-26bd6e1b5b49 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:52.071804 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-18aa78ea-69b7-48bd-8656-26bd6e1b5b49 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:52.115986 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4bd547d6-b6c8-4194-a5e2-87cd0c7bafe4 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 200 len: 38332 microversion: 2.1 time: 0.106400 Nov 23 04:22:52.121482 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 532/1005] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:52 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 38332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:22:52.126945 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-590a294f-999d-457b-9d2e-1957ee71e134 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:52.127575 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-590a294f-999d-457b-9d2e-1957ee71e134 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:52.134597 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-590a294f-999d-457b-9d2e-1957ee71e134 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:52.135041 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-590a294f-999d-457b-9d2e-1957ee71e134 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:52.135846 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-590a294f-999d-457b-9d2e-1957ee71e134 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:52.136278 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-590a294f-999d-457b-9d2e-1957ee71e134 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:52.163515 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-590a294f-999d-457b-9d2e-1957ee71e134 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/ips" status: 200 len: 145 microversion: 2.1 time: 0.040528 Nov 23 04:22:52.164096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 533/1006] 10.222.0.54 () {58 vars in 1247 bytes} [Tue Nov 23 04:22:52 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:22:52.211089 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-18aa78ea-69b7-48bd-8656-26bd6e1b5b49 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:52.219058 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-18aa78ea-69b7-48bd-8656-26bd6e1b5b49 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.159328 Nov 23 04:22:52.219672 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 474/1007] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:52 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:22:53.236052 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-130b830c-fad8-4a49-a33e-7ae1297441f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:53.236660 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-130b830c-fad8-4a49-a33e-7ae1297441f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:53.242975 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-130b830c-fad8-4a49-a33e-7ae1297441f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:53.243461 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-130b830c-fad8-4a49-a33e-7ae1297441f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:53.244242 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-130b830c-fad8-4a49-a33e-7ae1297441f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:53.244676 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-130b830c-fad8-4a49-a33e-7ae1297441f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:53.381076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-130b830c-fad8-4a49-a33e-7ae1297441f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:53.388523 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-130b830c-fad8-4a49-a33e-7ae1297441f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.156123 Nov 23 04:22:53.389096 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 534/1008] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:53 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:22:54.406001 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-77671320-0690-44b7-800a-9e16d4e69c4b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:54.406586 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-77671320-0690-44b7-800a-9e16d4e69c4b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:54.413198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-77671320-0690-44b7-800a-9e16d4e69c4b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:54.413636 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-77671320-0690-44b7-800a-9e16d4e69c4b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:54.414432 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-77671320-0690-44b7-800a-9e16d4e69c4b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:54.414862 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-77671320-0690-44b7-800a-9e16d4e69c4b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:54.549602 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-77671320-0690-44b7-800a-9e16d4e69c4b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:54.556923 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-77671320-0690-44b7-800a-9e16d4e69c4b tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.155327 Nov 23 04:22:54.557673 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 475/1009] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:54 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:54.611067 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c11bd874-8e16-420d-ab31-eb262b9afe18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa0cb0ae-0e74-4763-83f3-58aacad48411"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:54.612161 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c11bd874-8e16-420d-ab31-eb262b9afe18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:54.618397 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c11bd874-8e16-420d-ab31-eb262b9afe18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:54.618845 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c11bd874-8e16-420d-ab31-eb262b9afe18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:54.619646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c11bd874-8e16-420d-ab31-eb262b9afe18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:54.620080 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c11bd874-8e16-420d-ab31-eb262b9afe18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:55.206822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c11bd874-8e16-420d-ab31-eb262b9afe18 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.599159 Nov 23 04:22:55.207505 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 535/1010] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:22:54 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:22:55.573851 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f69f1dfa-2aa2-4b31-b254-90f3c53f2df4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:55.575187 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f69f1dfa-2aa2-4b31-b254-90f3c53f2df4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:55.581600 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f69f1dfa-2aa2-4b31-b254-90f3c53f2df4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:55.582045 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f69f1dfa-2aa2-4b31-b254-90f3c53f2df4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:55.582825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f69f1dfa-2aa2-4b31-b254-90f3c53f2df4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:55.583277 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f69f1dfa-2aa2-4b31-b254-90f3c53f2df4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:55.784280 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f69f1dfa-2aa2-4b31-b254-90f3c53f2df4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:55.791751 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f69f1dfa-2aa2-4b31-b254-90f3c53f2df4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.221607 Nov 23 04:22:55.794484 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 476/1011] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:55 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:56.809725 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-611a268b-c8c7-472b-9351-21ea7fd385f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:56.810528 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-611a268b-c8c7-472b-9351-21ea7fd385f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:56.816646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-611a268b-c8c7-472b-9351-21ea7fd385f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:56.817091 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-611a268b-c8c7-472b-9351-21ea7fd385f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:56.817865 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-611a268b-c8c7-472b-9351-21ea7fd385f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:56.818292 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-611a268b-c8c7-472b-9351-21ea7fd385f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:56.948355 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-611a268b-c8c7-472b-9351-21ea7fd385f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:56.956267 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-611a268b-c8c7-472b-9351-21ea7fd385f0 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.151014 Nov 23 04:22:56.956832 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 536/1012] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:56 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:57.974603 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-60a760f8-0f71-4ae1-92e2-bea8b31bfad1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:57.975145 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-60a760f8-0f71-4ae1-92e2-bea8b31bfad1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:57.982143 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60a760f8-0f71-4ae1-92e2-bea8b31bfad1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:57.982956 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60a760f8-0f71-4ae1-92e2-bea8b31bfad1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:57.983594 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60a760f8-0f71-4ae1-92e2-bea8b31bfad1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:57.984030 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-60a760f8-0f71-4ae1-92e2-bea8b31bfad1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:58.120460 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-60a760f8-0f71-4ae1-92e2-bea8b31bfad1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:58.127986 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-60a760f8-0f71-4ae1-92e2-bea8b31bfad1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.157202 Nov 23 04:22:58.128552 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 477/1013] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:57 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:59.145087 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bbbc3b87-4c1a-422a-8b42-09e28731843c tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:59.145680 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bbbc3b87-4c1a-422a-8b42-09e28731843c tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:59.151940 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bbbc3b87-4c1a-422a-8b42-09e28731843c tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:59.152427 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bbbc3b87-4c1a-422a-8b42-09e28731843c tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:59.153642 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bbbc3b87-4c1a-422a-8b42-09e28731843c tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:59.154073 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bbbc3b87-4c1a-422a-8b42-09e28731843c tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:59.288983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-bbbc3b87-4c1a-422a-8b42-09e28731843c tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:59.296972 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bbbc3b87-4c1a-422a-8b42-09e28731843c tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1568 microversion: 2.1 time: 0.155499 Nov 23 04:22:59.297542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 537/1014] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:59 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:22:59.313938 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-beeeff68-dddf-42d4-8660-ebb75f0e648e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:22:59.314506 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-beeeff68-dddf-42d4-8660-ebb75f0e648e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:59.320961 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-beeeff68-dddf-42d4-8660-ebb75f0e648e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:59.321422 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-beeeff68-dddf-42d4-8660-ebb75f0e648e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:59.322198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-beeeff68-dddf-42d4-8660-ebb75f0e648e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:59.322629 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-beeeff68-dddf-42d4-8660-ebb75f0e648e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:59.690390 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-beeeff68-dddf-42d4-8660-ebb75f0e648e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "POST /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71/action" status: 202 len: 0 microversion: 2.1 time: 0.380481 Nov 23 04:22:59.691034 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 478/1015] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:22:59 2021] POST /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:22:59.698923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d55cd42d-b08c-4401-823f-0909c8e4c108 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:22:59.699802 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d55cd42d-b08c-4401-823f-0909c8e4c108 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:22:59.705799 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d55cd42d-b08c-4401-823f-0909c8e4c108 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:59.706244 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d55cd42d-b08c-4401-823f-0909c8e4c108 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:59.707026 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d55cd42d-b08c-4401-823f-0909c8e4c108 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:22:59.707522 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d55cd42d-b08c-4401-823f-0909c8e4c108 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:22:59.845427 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d55cd42d-b08c-4401-823f-0909c8e4c108 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:22:59.853015 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d55cd42d-b08c-4401-823f-0909c8e4c108 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1516 microversion: 2.1 time: 0.157722 Nov 23 04:22:59.853877 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 538/1016] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:22:59 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:00.770636 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-dd7d9500-663b-4195-a25e-873f2aa59b41 req-ce576b19-049e-4a63-bf57-0482cca72abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe99c22a-d75b-4a5c-8800-6a65d64ded71", "name": "network-vif-unplugged", "status": "completed", "tag": "6785c855-b933-47d9-95d0-982e7c07f503"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:23:00.772308 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:23:00.772308 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:23:00.780273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-dd7d9500-663b-4195-a25e-873f2aa59b41 req-ce576b19-049e-4a63-bf57-0482cca72abf service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:00.780719 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-dd7d9500-663b-4195-a25e-873f2aa59b41 req-ce576b19-049e-4a63-bf57-0482cca72abf service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:00.791880 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.compute.server_external_events [req-dd7d9500-663b-4195-a25e-873f2aa59b41 req-ce576b19-049e-4a63-bf57-0482cca72abf service nova] Unable to find a host for instance fe99c22a-d75b-4a5c-8800-6a65d64ded71. Dropping event network-vif-unplugged {{(pid=116837) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 23 04:23:00.792737 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-dd7d9500-663b-4195-a25e-873f2aa59b41 req-ce576b19-049e-4a63-bf57-0482cca72abf service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026004 Nov 23 04:23:00.793368 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 479/1017] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:23:00 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 23 04:23:00.870662 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ca41d5b3-d272-4325-acad-87a38c62046e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:00.871886 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ca41d5b3-d272-4325-acad-87a38c62046e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:00.878422 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca41d5b3-d272-4325-acad-87a38c62046e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:00.878872 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca41d5b3-d272-4325-acad-87a38c62046e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:00.879689 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca41d5b3-d272-4325-acad-87a38c62046e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:00.880127 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ca41d5b3-d272-4325-acad-87a38c62046e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:01.010930 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ca41d5b3-d272-4325-acad-87a38c62046e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:01.018890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ca41d5b3-d272-4325-acad-87a38c62046e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1518 microversion: 2.1 time: 0.151861 Nov 23 04:23:01.019498 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 539/1018] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:00 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:02.036373 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-31799a99-70f6-457d-b247-7ca3378c8dad tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:02.036989 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-31799a99-70f6-457d-b247-7ca3378c8dad tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:02.043253 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-31799a99-70f6-457d-b247-7ca3378c8dad tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:02.043729 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-31799a99-70f6-457d-b247-7ca3378c8dad tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:02.044502 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-31799a99-70f6-457d-b247-7ca3378c8dad tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:02.044937 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-31799a99-70f6-457d-b247-7ca3378c8dad tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:02.178053 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-31799a99-70f6-457d-b247-7ca3378c8dad tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:02.185710 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-31799a99-70f6-457d-b247-7ca3378c8dad tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1518 microversion: 2.1 time: 0.153283 Nov 23 04:23:02.186269 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 480/1019] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:02 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:02.698997 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5ba8b250-b53c-4c5d-8862-f781b4573251 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:23:02.705871 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5ba8b250-b53c-4c5d-8862-f781b4573251 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:02.706311 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5ba8b250-b53c-4c5d-8862-f781b4573251 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:02.765729 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5ba8b250-b53c-4c5d-8862-f781b4573251 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Going to try to stop instance {{(pid=116836) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 23 04:23:03.079439 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5ba8b250-b53c-4c5d-8862-f781b4573251 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 202 len: 0 microversion: 2.1 time: 0.383900 Nov 23 04:23:03.080044 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 540/1020] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:23:02 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:23:03.087744 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c0d2a20d-b290-458c-990b-6964e21c6d83 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:03.088354 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c0d2a20d-b290-458c-990b-6964e21c6d83 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:03.095204 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c0d2a20d-b290-458c-990b-6964e21c6d83 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:03.095695 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c0d2a20d-b290-458c-990b-6964e21c6d83 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:03.096475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c0d2a20d-b290-458c-990b-6964e21c6d83 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:03.096911 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c0d2a20d-b290-458c-990b-6964e21c6d83 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:03.203452 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f589247d-f2cf-4523-abf4-41569311b212 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:03.204157 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f589247d-f2cf-4523-abf4-41569311b212 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:03.210112 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f589247d-f2cf-4523-abf4-41569311b212 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:03.210569 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f589247d-f2cf-4523-abf4-41569311b212 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:03.211395 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f589247d-f2cf-4523-abf4-41569311b212 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:03.211837 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f589247d-f2cf-4523-abf4-41569311b212 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:03.227956 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c0d2a20d-b290-458c-990b-6964e21c6d83 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:03.241464 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c0d2a20d-b290-458c-990b-6964e21c6d83 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.157189 Nov 23 04:23:03.250288 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 481/1021] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:03 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:03.356165 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f589247d-f2cf-4523-abf4-41569311b212 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:03.364915 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f589247d-f2cf-4523-abf4-41569311b212 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1518 microversion: 2.1 time: 0.164191 Nov 23 04:23:03.364915 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 541/1022] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:03 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:04.259757 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9d64abfe-6977-4b61-b7f8-4045224cfe80 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:04.260387 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9d64abfe-6977-4b61-b7f8-4045224cfe80 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:04.267054 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9d64abfe-6977-4b61-b7f8-4045224cfe80 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:04.267534 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9d64abfe-6977-4b61-b7f8-4045224cfe80 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:04.268311 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9d64abfe-6977-4b61-b7f8-4045224cfe80 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:04.268758 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9d64abfe-6977-4b61-b7f8-4045224cfe80 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:04.379912 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a97b2969-68d3-4d8f-af16-fdd9b896b941 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:04.380510 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a97b2969-68d3-4d8f-af16-fdd9b896b941 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:04.386838 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a97b2969-68d3-4d8f-af16-fdd9b896b941 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:04.387376 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a97b2969-68d3-4d8f-af16-fdd9b896b941 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:04.388163 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a97b2969-68d3-4d8f-af16-fdd9b896b941 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:04.388615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a97b2969-68d3-4d8f-af16-fdd9b896b941 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:04.405482 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9d64abfe-6977-4b61-b7f8-4045224cfe80 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:04.413720 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9d64abfe-6977-4b61-b7f8-4045224cfe80 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.157857 Nov 23 04:23:04.414326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 482/1023] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:04 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:04.519903 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a97b2969-68d3-4d8f-af16-fdd9b896b941 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:04.527056 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a97b2969-68d3-4d8f-af16-fdd9b896b941 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1574 microversion: 2.1 time: 0.150757 Nov 23 04:23:04.527690 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 542/1024] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:04 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:05.431673 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-51ea0d38-ec04-488e-a3c2-2a9c6b931485 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:05.432204 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-51ea0d38-ec04-488e-a3c2-2a9c6b931485 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:05.439272 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-51ea0d38-ec04-488e-a3c2-2a9c6b931485 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:05.439719 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-51ea0d38-ec04-488e-a3c2-2a9c6b931485 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:05.440485 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-51ea0d38-ec04-488e-a3c2-2a9c6b931485 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:05.440925 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-51ea0d38-ec04-488e-a3c2-2a9c6b931485 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:05.545130 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-73ae27f0-2069-4c7a-b667-e3399e4c1da4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:05.546061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-73ae27f0-2069-4c7a-b667-e3399e4c1da4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:05.552797 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-73ae27f0-2069-4c7a-b667-e3399e4c1da4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:05.553240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-73ae27f0-2069-4c7a-b667-e3399e4c1da4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:05.554038 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-73ae27f0-2069-4c7a-b667-e3399e4c1da4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:05.554476 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-73ae27f0-2069-4c7a-b667-e3399e4c1da4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:05.864432 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-51ea0d38-ec04-488e-a3c2-2a9c6b931485 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:05.872938 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-51ea0d38-ec04-488e-a3c2-2a9c6b931485 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.444935 Nov 23 04:23:05.873507 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 483/1025] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:05 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:05.929654 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-73ae27f0-2069-4c7a-b667-e3399e4c1da4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:05.937121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-73ae27f0-2069-4c7a-b667-e3399e4c1da4 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1574 microversion: 2.1 time: 0.396408 Nov 23 04:23:05.937686 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 543/1026] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:05 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1574 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:06.889897 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8880effe-bc54-4550-b5d1-9132d603461d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:06.890503 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8880effe-bc54-4550-b5d1-9132d603461d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:06.896804 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8880effe-bc54-4550-b5d1-9132d603461d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:06.897264 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8880effe-bc54-4550-b5d1-9132d603461d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:06.898038 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8880effe-bc54-4550-b5d1-9132d603461d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:06.898472 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8880effe-bc54-4550-b5d1-9132d603461d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:06.953794 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-eca03d35-c400-473f-9b41-f325031f2432 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:06.954430 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-eca03d35-c400-473f-9b41-f325031f2432 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:06.960812 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eca03d35-c400-473f-9b41-f325031f2432 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:06.961333 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eca03d35-c400-473f-9b41-f325031f2432 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:06.962178 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eca03d35-c400-473f-9b41-f325031f2432 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:06.962692 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-eca03d35-c400-473f-9b41-f325031f2432 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:07.062666 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8880effe-bc54-4550-b5d1-9132d603461d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:07.070566 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8880effe-bc54-4550-b5d1-9132d603461d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.184529 Nov 23 04:23:07.071135 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 484/1027] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:06 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:07.125248 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-eca03d35-c400-473f-9b41-f325031f2432 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:07.132516 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-eca03d35-c400-473f-9b41-f325031f2432 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1574 microversion: 2.1 time: 0.182597 Nov 23 04:23:07.133083 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 544/1028] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:06 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:08.087326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-66df097b-a9d3-4898-a42f-396eaffe7828 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:08.087938 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-66df097b-a9d3-4898-a42f-396eaffe7828 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:08.094735 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-66df097b-a9d3-4898-a42f-396eaffe7828 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:08.095105 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-66df097b-a9d3-4898-a42f-396eaffe7828 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:08.095919 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-66df097b-a9d3-4898-a42f-396eaffe7828 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:08.096352 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-66df097b-a9d3-4898-a42f-396eaffe7828 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:08.148701 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f9961eec-2a1c-4159-81bd-f3b3e6d0fbd1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:08.149299 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f9961eec-2a1c-4159-81bd-f3b3e6d0fbd1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:08.155650 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9961eec-2a1c-4159-81bd-f3b3e6d0fbd1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:08.156098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9961eec-2a1c-4159-81bd-f3b3e6d0fbd1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:08.156875 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9961eec-2a1c-4159-81bd-f3b3e6d0fbd1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:08.157302 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f9961eec-2a1c-4159-81bd-f3b3e6d0fbd1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:08.255146 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-66df097b-a9d3-4898-a42f-396eaffe7828 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:08.263006 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-66df097b-a9d3-4898-a42f-396eaffe7828 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.179270 Nov 23 04:23:08.263849 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 485/1029] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:08 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:08.317951 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f9961eec-2a1c-4159-81bd-f3b3e6d0fbd1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:08.325203 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f9961eec-2a1c-4159-81bd-f3b3e6d0fbd1 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1574 microversion: 2.1 time: 0.180191 Nov 23 04:23:08.325818 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 545/1030] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:08 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:09.279848 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f48c7723-4686-421d-a12f-0c2c5bf27be9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:09.280452 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f48c7723-4686-421d-a12f-0c2c5bf27be9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:09.286860 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f48c7723-4686-421d-a12f-0c2c5bf27be9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:09.287342 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f48c7723-4686-421d-a12f-0c2c5bf27be9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:09.288121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f48c7723-4686-421d-a12f-0c2c5bf27be9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:09.288551 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f48c7723-4686-421d-a12f-0c2c5bf27be9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:09.342107 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0573b551-b5c9-49e8-a6b4-f4b11b073c63 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:09.342725 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0573b551-b5c9-49e8-a6b4-f4b11b073c63 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:09.349102 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0573b551-b5c9-49e8-a6b4-f4b11b073c63 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:09.349557 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0573b551-b5c9-49e8-a6b4-f4b11b073c63 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:09.350367 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0573b551-b5c9-49e8-a6b4-f4b11b073c63 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:09.350803 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0573b551-b5c9-49e8-a6b4-f4b11b073c63 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:09.448175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f48c7723-4686-421d-a12f-0c2c5bf27be9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:09.456008 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f48c7723-4686-421d-a12f-0c2c5bf27be9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.179866 Nov 23 04:23:09.456714 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 486/1031] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:09 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:09.510511 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0573b551-b5c9-49e8-a6b4-f4b11b073c63 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:09.517978 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0573b551-b5c9-49e8-a6b4-f4b11b073c63 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1574 microversion: 2.1 time: 0.179999 Nov 23 04:23:09.518539 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 546/1032] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:09 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:10.052527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b0c7cf8d-b66b-4b99-9c40-e9e5b324b564 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:10.053026 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b0c7cf8d-b66b-4b99-9c40-e9e5b324b564 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:10.058900 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b0c7cf8d-b66b-4b99-9c40-e9e5b324b564 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:10.059393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b0c7cf8d-b66b-4b99-9c40-e9e5b324b564 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:10.060199 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b0c7cf8d-b66b-4b99-9c40-e9e5b324b564 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:10.060638 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b0c7cf8d-b66b-4b99-9c40-e9e5b324b564 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:10.083693 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b0c7cf8d-b66b-4b99-9c40-e9e5b324b564 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Going to try to terminate instance {{(pid=116837) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:23:10.322247 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b0c7cf8d-b66b-4b99-9c40-e9e5b324b564 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "DELETE /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 204 len: 0 microversion: 2.1 time: 0.273124 Nov 23 04:23:10.322892 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 487/1033] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:23:10 2021] DELETE /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:23:10.331553 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b961270d-82fe-4e7f-a756-a09dc82f25e7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:10.332171 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b961270d-82fe-4e7f-a756-a09dc82f25e7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:10.338102 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b961270d-82fe-4e7f-a756-a09dc82f25e7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:10.338551 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b961270d-82fe-4e7f-a756-a09dc82f25e7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:10.339364 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b961270d-82fe-4e7f-a756-a09dc82f25e7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:10.339807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b961270d-82fe-4e7f-a756-a09dc82f25e7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:10.470825 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b961270d-82fe-4e7f-a756-a09dc82f25e7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:10.473954 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f2a7057a-208a-466b-97b6-e02055c884b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:10.474661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f2a7057a-208a-466b-97b6-e02055c884b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:10.478219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b961270d-82fe-4e7f-a756-a09dc82f25e7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1577 microversion: 2.1 time: 0.150365 Nov 23 04:23:10.478808 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 547/1034] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:10 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:10.481121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f2a7057a-208a-466b-97b6-e02055c884b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:10.481544 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f2a7057a-208a-466b-97b6-e02055c884b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:10.482323 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f2a7057a-208a-466b-97b6-e02055c884b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:10.482767 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f2a7057a-208a-466b-97b6-e02055c884b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:10.535868 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d38b6fb7-60b3-41b5-9f31-5310632ae433 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:10.536471 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d38b6fb7-60b3-41b5-9f31-5310632ae433 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:10.542296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d38b6fb7-60b3-41b5-9f31-5310632ae433 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:10.542736 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d38b6fb7-60b3-41b5-9f31-5310632ae433 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:10.543534 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d38b6fb7-60b3-41b5-9f31-5310632ae433 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:10.543963 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d38b6fb7-60b3-41b5-9f31-5310632ae433 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:10.647422 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f2a7057a-208a-466b-97b6-e02055c884b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:10.655355 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f2a7057a-208a-466b-97b6-e02055c884b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.185192 Nov 23 04:23:10.655958 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 488/1035] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:10 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:10.708533 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d38b6fb7-60b3-41b5-9f31-5310632ae433 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:10.715865 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d38b6fb7-60b3-41b5-9f31-5310632ae433 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1574 microversion: 2.1 time: 0.183868 Nov 23 04:23:10.716432 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 548/1036] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:10 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:11.495409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1ea48c42-b115-4253-8c3b-9a3a161b8d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:11.496021 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1ea48c42-b115-4253-8c3b-9a3a161b8d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:11.502350 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ea48c42-b115-4253-8c3b-9a3a161b8d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:11.502791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ea48c42-b115-4253-8c3b-9a3a161b8d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:11.503579 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ea48c42-b115-4253-8c3b-9a3a161b8d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:11.504013 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1ea48c42-b115-4253-8c3b-9a3a161b8d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:11.635735 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-1ea48c42-b115-4253-8c3b-9a3a161b8d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:11.643887 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1ea48c42-b115-4253-8c3b-9a3a161b8d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1577 microversion: 2.1 time: 0.152015 Nov 23 04:23:11.644472 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 489/1037] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:11 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:11.673481 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1da2c4ea-08b7-43a6-b22f-62fb3b6d3208 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:11.674082 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1da2c4ea-08b7-43a6-b22f-62fb3b6d3208 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:11.680444 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1da2c4ea-08b7-43a6-b22f-62fb3b6d3208 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:11.681172 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1da2c4ea-08b7-43a6-b22f-62fb3b6d3208 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:11.681654 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1da2c4ea-08b7-43a6-b22f-62fb3b6d3208 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:11.682086 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1da2c4ea-08b7-43a6-b22f-62fb3b6d3208 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:11.733563 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6c499286-a65e-4723-a1bf-48215dec4a52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:11.734177 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6c499286-a65e-4723-a1bf-48215dec4a52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:11.740072 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6c499286-a65e-4723-a1bf-48215dec4a52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:11.740516 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6c499286-a65e-4723-a1bf-48215dec4a52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:11.741291 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6c499286-a65e-4723-a1bf-48215dec4a52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:11.741732 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6c499286-a65e-4723-a1bf-48215dec4a52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:11.848974 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1da2c4ea-08b7-43a6-b22f-62fb3b6d3208 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:11.856750 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1da2c4ea-08b7-43a6-b22f-62fb3b6d3208 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.187732 Nov 23 04:23:11.857315 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 549/1038] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:11 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:11.907113 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6c499286-a65e-4723-a1bf-48215dec4a52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:11.914570 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6c499286-a65e-4723-a1bf-48215dec4a52 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1574 microversion: 2.1 time: 0.184827 Nov 23 04:23:11.915143 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 490/1039] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:11 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:12.660636 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e8e04190-afa0-4a27-ad56-e1c0e246b731 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:12.661243 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e8e04190-afa0-4a27-ad56-e1c0e246b731 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:12.666969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8e04190-afa0-4a27-ad56-e1c0e246b731 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:12.667452 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8e04190-afa0-4a27-ad56-e1c0e246b731 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:12.668242 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8e04190-afa0-4a27-ad56-e1c0e246b731 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:12.668670 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8e04190-afa0-4a27-ad56-e1c0e246b731 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:12.875359 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c8abc371-957c-43e3-b2c8-d7aefdf33573 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:12.876161 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c8abc371-957c-43e3-b2c8-d7aefdf33573 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:12.882692 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c8abc371-957c-43e3-b2c8-d7aefdf33573 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:12.883152 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c8abc371-957c-43e3-b2c8-d7aefdf33573 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:12.883978 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c8abc371-957c-43e3-b2c8-d7aefdf33573 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:12.884421 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c8abc371-957c-43e3-b2c8-d7aefdf33573 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:12.936930 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e8e04190-afa0-4a27-ad56-e1c0e246b731 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:12.946754 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e8e04190-afa0-4a27-ad56-e1c0e246b731 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1577 microversion: 2.1 time: 0.289970 Nov 23 04:23:12.947361 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 550/1040] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:12 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1577 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:12.951579 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dff71365-fd65-4c27-9a04-55df2d803d8f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:12.952684 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dff71365-fd65-4c27-9a04-55df2d803d8f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:12.958527 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dff71365-fd65-4c27-9a04-55df2d803d8f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:12.958969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dff71365-fd65-4c27-9a04-55df2d803d8f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:12.959718 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dff71365-fd65-4c27-9a04-55df2d803d8f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:12.960156 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dff71365-fd65-4c27-9a04-55df2d803d8f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:13.172882 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c8abc371-957c-43e3-b2c8-d7aefdf33573 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:13.182119 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c8abc371-957c-43e3-b2c8-d7aefdf33573 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.310355 Nov 23 04:23:13.182719 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 491/1041] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:12 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:13.246355 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dff71365-fd65-4c27-9a04-55df2d803d8f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:13.255193 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dff71365-fd65-4c27-9a04-55df2d803d8f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1574 microversion: 2.1 time: 0.306678 Nov 23 04:23:13.271054 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 551/1042] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:12 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1574 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:13.281185 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-a526ec6d-9d3b-444a-a19b-9fdb2d31e92d req-9bfd922a-ec51-4eaf-8750-cfca60b734a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94641710-5efb-41aa-acde-03bacf08f49e", "name": "network-vif-deleted", "tag": "2df4ffb6-9def-4b79-91c3-ffeb6dc7fd68"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:23:13.282765 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:23:13.282765 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:23:13.290137 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-a526ec6d-9d3b-444a-a19b-9fdb2d31e92d req-9bfd922a-ec51-4eaf-8750-cfca60b734a6 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:13.290572 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-a526ec6d-9d3b-444a-a19b-9fdb2d31e92d req-9bfd922a-ec51-4eaf-8750-cfca60b734a6 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:13.457084 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-a526ec6d-9d3b-444a-a19b-9fdb2d31e92d req-9bfd922a-ec51-4eaf-8750-cfca60b734a6 service nova] Creating event network-vif-deleted:2df4ffb6-9def-4b79-91c3-ffeb6dc7fd68 for instance 94641710-5efb-41aa-acde-03bacf08f49e on hv-cinder-76845 Nov 23 04:23:13.462308 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-a526ec6d-9d3b-444a-a19b-9fdb2d31e92d req-9bfd922a-ec51-4eaf-8750-cfca60b734a6 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186731 Nov 23 04:23:13.463282 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 492/1043] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:23:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:23:13.963284 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:13.963877 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:13.970424 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:13.970869 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:13.971940 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:13.972561 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:14.006057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:14.006505 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:14.006955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lazy-loading 'fault' on Instance uuid 94641710-5efb-41aa-acde-03bacf08f49e {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:23:14.049517 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:14.057256 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9ea67736-2682-40b4-a46b-a11dbe0cab1c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 200 len: 1230 microversion: 2.1 time: 0.097762 Nov 23 04:23:14.058152 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 552/1044] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:13 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:14.200229 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-649659da-f3bf-47fe-8590-1b676c2d08a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:14.201624 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-649659da-f3bf-47fe-8590-1b676c2d08a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:14.207966 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-649659da-f3bf-47fe-8590-1b676c2d08a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:14.208586 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-649659da-f3bf-47fe-8590-1b676c2d08a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:14.209437 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-649659da-f3bf-47fe-8590-1b676c2d08a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:14.209900 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-649659da-f3bf-47fe-8590-1b676c2d08a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:14.272346 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-01bbb952-8bbb-4c2f-895a-8b319c1c6a6d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:14.274212 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-01bbb952-8bbb-4c2f-895a-8b319c1c6a6d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:14.281006 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01bbb952-8bbb-4c2f-895a-8b319c1c6a6d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:14.281910 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01bbb952-8bbb-4c2f-895a-8b319c1c6a6d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:14.285601 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01bbb952-8bbb-4c2f-895a-8b319c1c6a6d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:14.286137 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-01bbb952-8bbb-4c2f-895a-8b319c1c6a6d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:14.394761 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-649659da-f3bf-47fe-8590-1b676c2d08a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:14.402474 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-649659da-f3bf-47fe-8590-1b676c2d08a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.206707 Nov 23 04:23:14.403027 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 493/1045] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:14 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:14.460603 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-01bbb952-8bbb-4c2f-895a-8b319c1c6a6d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:14.468926 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-01bbb952-8bbb-4c2f-895a-8b319c1c6a6d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1574 microversion: 2.1 time: 0.200151 Nov 23 04:23:14.469574 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 553/1046] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:14 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:14.905670 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-e4f5b288-2b35-4dee-9e8a-a3ce4302c105 req-7dbd0507-2fc5-4731-9ba3-787eb361da87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe99c22a-d75b-4a5c-8800-6a65d64ded71", "name": "network-vif-plugged", "status": "completed", "tag": "6785c855-b933-47d9-95d0-982e7c07f503"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:23:14.907295 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:23:14.907295 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:23:14.914325 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-e4f5b288-2b35-4dee-9e8a-a3ce4302c105 req-7dbd0507-2fc5-4731-9ba3-787eb361da87 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:14.914769 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-e4f5b288-2b35-4dee-9e8a-a3ce4302c105 req-7dbd0507-2fc5-4731-9ba3-787eb361da87 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:14.925173 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-e4f5b288-2b35-4dee-9e8a-a3ce4302c105 req-7dbd0507-2fc5-4731-9ba3-787eb361da87 service nova] Creating event network-vif-plugged:6785c855-b933-47d9-95d0-982e7c07f503 for instance fe99c22a-d75b-4a5c-8800-6a65d64ded71 on hv-cinder-76845 Nov 23 04:23:14.930049 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-e4f5b288-2b35-4dee-9e8a-a3ce4302c105 req-7dbd0507-2fc5-4731-9ba3-787eb361da87 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028726 Nov 23 04:23:14.930701 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 494/1047] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:23:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:23:15.074784 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5b1441f7-d26f-4867-8c9c-b8be1fd05d84 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:15.075445 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5b1441f7-d26f-4867-8c9c-b8be1fd05d84 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:15.083621 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5b1441f7-d26f-4867-8c9c-b8be1fd05d84 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:15.084063 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5b1441f7-d26f-4867-8c9c-b8be1fd05d84 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:15.084850 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5b1441f7-d26f-4867-8c9c-b8be1fd05d84 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:15.085276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5b1441f7-d26f-4867-8c9c-b8be1fd05d84 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:15.099889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-5b1441f7-d26f-4867-8c9c-b8be1fd05d84 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] HTTP exception thrown: Instance 94641710-5efb-41aa-acde-03bacf08f49e could not be found. Nov 23 04:23:15.100482 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5b1441f7-d26f-4867-8c9c-b8be1fd05d84 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Returning 404 to user: Instance 94641710-5efb-41aa-acde-03bacf08f49e could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:23:15.101306 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5b1441f7-d26f-4867-8c9c-b8be1fd05d84 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 404 len: 111 microversion: 2.1 time: 0.030256 Nov 23 04:23:15.101868 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 554/1048] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:15 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:23:15.203812 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1726133691", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-673532001", "security_groups": [{"name": "tempest-secgroup-smoke-354329014"}], "block_device_mapping_v2": [{"uuid": "e93acbc8-537b-4f6f-8b5d-e920541a3fac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3f5880c1-f079-4dc1-b8fc-71110c737c22"}]}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:23:15.344755 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.network.neutron [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] validate_networks() for [('3f5880c1-f079-4dc1-b8fc-71110c737c22', None, None, None, None, None)] {{(pid=116837) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:23:15.420430 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7bd3e5d8-9c60-43aa-9442-13525fa0aa9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:15.421038 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7bd3e5d8-9c60-43aa-9442-13525fa0aa9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:15.426702 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7bd3e5d8-9c60-43aa-9442-13525fa0aa9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:15.427144 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7bd3e5d8-9c60-43aa-9442-13525fa0aa9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:15.427949 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7bd3e5d8-9c60-43aa-9442-13525fa0aa9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:15.428376 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7bd3e5d8-9c60-43aa-9442-13525fa0aa9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:15.621252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-7bd3e5d8-9c60-43aa-9442-13525fa0aa9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:15.629610 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7bd3e5d8-9c60-43aa-9442-13525fa0aa9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.213329 Nov 23 04:23:15.636188 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 555/1049] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:15 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:15.636188 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6f569a5d-4908-4a78-a775-a75f567ab04e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:15.636188 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6f569a5d-4908-4a78-a775-a75f567ab04e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:15.644388 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f569a5d-4908-4a78-a775-a75f567ab04e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:15.644842 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f569a5d-4908-4a78-a775-a75f567ab04e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:15.645657 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f569a5d-4908-4a78-a775-a75f567ab04e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:15.646068 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6f569a5d-4908-4a78-a775-a75f567ab04e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:15.866814 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6f569a5d-4908-4a78-a775-a75f567ab04e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:15.874298 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6f569a5d-4908-4a78-a775-a75f567ab04e tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1574 microversion: 2.1 time: 0.243143 Nov 23 04:23:15.874890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 556/1050] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:15 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1574 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:15.889035 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Flavor limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:23:15.889471 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Image limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:23:15.889946 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Flavor pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:23:15.890360 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Image pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:23:15.890780 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:23:15.899300 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:15.899751 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:15.900569 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:15.901008 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:15.917459 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Getting quotas for project 8068470657b040ab9af34219d8935846. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:23:15.921845 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Getting quotas for user 97e3605d1b0045e48d5836380ce77dc6 and project 8068470657b040ab9af34219d8935846. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:23:15.975327 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Going to run 1 instances... {{(pid=116837) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:23:15.977513 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e93acbc8-537b-4f6f-8b5d-e920541a3fac',volume_size=None,volume_type=None)] {{(pid=116837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:23:16.329639 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-38f5e0ce-f056-49c8-a1c4-a3364187b55c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.131486 Nov 23 04:23:16.330262 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 495/1051] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:23:15 2021] POST /compute/v2.1/servers => generated 405 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:23:16.340121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b14f2b76-6f61-43d3-94fb-93b3a3ac1d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:16.340730 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b14f2b76-6f61-43d3-94fb-93b3a3ac1d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:16.398852 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b14f2b76-6f61-43d3-94fb-93b3a3ac1d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:16.406360 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b14f2b76-6f61-43d3-94fb-93b3a3ac1d8e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1094 microversion: 2.1 time: 0.069977 Nov 23 04:23:16.406922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 557/1052] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:16 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:16.647626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-30755c39-5812-49ff-b967-740fa0e243a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:16.648273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-30755c39-5812-49ff-b967-740fa0e243a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:16.654510 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-30755c39-5812-49ff-b967-740fa0e243a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:16.657220 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-30755c39-5812-49ff-b967-740fa0e243a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:16.657220 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-30755c39-5812-49ff-b967-740fa0e243a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:16.657220 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-30755c39-5812-49ff-b967-740fa0e243a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:16.788835 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-30755c39-5812-49ff-b967-740fa0e243a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:16.797336 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-30755c39-5812-49ff-b967-740fa0e243a6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.153430 Nov 23 04:23:16.797904 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 496/1053] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:16 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:16.892767 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-85f7cd0c-7c21-4434-bb2e-190a6dbbfd3a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:16.893376 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-85f7cd0c-7c21-4434-bb2e-190a6dbbfd3a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:16.899312 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-85f7cd0c-7c21-4434-bb2e-190a6dbbfd3a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:16.899763 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-85f7cd0c-7c21-4434-bb2e-190a6dbbfd3a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:16.900540 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-85f7cd0c-7c21-4434-bb2e-190a6dbbfd3a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:16.900973 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-85f7cd0c-7c21-4434-bb2e-190a6dbbfd3a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:17.032405 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-85f7cd0c-7c21-4434-bb2e-190a6dbbfd3a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:17.040171 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-85f7cd0c-7c21-4434-bb2e-190a6dbbfd3a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1561 microversion: 2.1 time: 0.151781 Nov 23 04:23:17.040731 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 558/1054] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:16 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:17.424119 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-820b36e5-e31c-42b9-8c26-d6725da39081 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:17.424731 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-820b36e5-e31c-42b9-8c26-d6725da39081 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:17.431029 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-820b36e5-e31c-42b9-8c26-d6725da39081 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:17.431511 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-820b36e5-e31c-42b9-8c26-d6725da39081 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:17.437367 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-820b36e5-e31c-42b9-8c26-d6725da39081 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:17.437367 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-820b36e5-e31c-42b9-8c26-d6725da39081 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:17.494801 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-820b36e5-e31c-42b9-8c26-d6725da39081 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:17.506087 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-820b36e5-e31c-42b9-8c26-d6725da39081 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1144 microversion: 2.1 time: 0.082688 Nov 23 04:23:17.506087 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 497/1055] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:17 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:17.814995 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-41a4a0fb-4bdb-4526-86d1-f6259389b764 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:17.815551 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-41a4a0fb-4bdb-4526-86d1-f6259389b764 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:17.822691 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-41a4a0fb-4bdb-4526-86d1-f6259389b764 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:17.823144 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-41a4a0fb-4bdb-4526-86d1-f6259389b764 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:17.823961 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-41a4a0fb-4bdb-4526-86d1-f6259389b764 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:17.824403 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-41a4a0fb-4bdb-4526-86d1-f6259389b764 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:17.958718 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-41a4a0fb-4bdb-4526-86d1-f6259389b764 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:17.966584 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-41a4a0fb-4bdb-4526-86d1-f6259389b764 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1723 microversion: 2.1 time: 0.156655 Nov 23 04:23:17.967545 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 559/1056] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:17 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:18.519101 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e19ecafd-1af9-49a2-8396-d9f989339885 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:18.527978 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e19ecafd-1af9-49a2-8396-d9f989339885 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:18.534700 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e19ecafd-1af9-49a2-8396-d9f989339885 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:18.535145 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e19ecafd-1af9-49a2-8396-d9f989339885 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:18.535963 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e19ecafd-1af9-49a2-8396-d9f989339885 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:18.536417 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e19ecafd-1af9-49a2-8396-d9f989339885 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:18.614861 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e19ecafd-1af9-49a2-8396-d9f989339885 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:18.623179 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e19ecafd-1af9-49a2-8396-d9f989339885 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1210 microversion: 2.1 time: 0.107681 Nov 23 04:23:18.640604 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 498/1057] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:18 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:18.984640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e2e9d881-c231-45eb-929b-57c210c84560 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:18.985272 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e2e9d881-c231-45eb-929b-57c210c84560 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:18.991615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2e9d881-c231-45eb-929b-57c210c84560 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:18.992061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2e9d881-c231-45eb-929b-57c210c84560 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:18.992846 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2e9d881-c231-45eb-929b-57c210c84560 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:18.993278 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e2e9d881-c231-45eb-929b-57c210c84560 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:19.170498 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-e2e9d881-c231-45eb-929b-57c210c84560 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:19.179165 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e2e9d881-c231-45eb-929b-57c210c84560 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1700 microversion: 2.1 time: 0.198989 Nov 23 04:23:19.179808 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 560/1058] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:18 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1700 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:19.200470 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f53dfb23-9525-4d8f-ba7d-5487cf713873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:23:19.211124 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f53dfb23-9525-4d8f-ba7d-5487cf713873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:19.211923 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f53dfb23-9525-4d8f-ba7d-5487cf713873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:19.288747 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f53dfb23-9525-4d8f-ba7d-5487cf713873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Going to try to start instance {{(pid=116837) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 23 04:23:19.507809 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f53dfb23-9525-4d8f-ba7d-5487cf713873 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 202 len: 0 microversion: 2.1 time: 0.314499 Nov 23 04:23:19.508327 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 499/1059] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:23:19 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:23:19.517147 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dc89128e-b462-4629-bbd3-b44aabe7d2db tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:19.517944 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dc89128e-b462-4629-bbd3-b44aabe7d2db tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:19.524166 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc89128e-b462-4629-bbd3-b44aabe7d2db tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:19.524789 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc89128e-b462-4629-bbd3-b44aabe7d2db tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:19.525774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc89128e-b462-4629-bbd3-b44aabe7d2db tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:19.526279 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dc89128e-b462-4629-bbd3-b44aabe7d2db tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:19.643076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-570bbca6-04f2-4229-8ec0-690df0a8f950 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:19.644408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-570bbca6-04f2-4229-8ec0-690df0a8f950 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:19.650607 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-570bbca6-04f2-4229-8ec0-690df0a8f950 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:19.651093 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-570bbca6-04f2-4229-8ec0-690df0a8f950 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:19.652179 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-570bbca6-04f2-4229-8ec0-690df0a8f950 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:19.652618 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-570bbca6-04f2-4229-8ec0-690df0a8f950 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:19.839377 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dc89128e-b462-4629-bbd3-b44aabe7d2db tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:19.847985 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dc89128e-b462-4629-bbd3-b44aabe7d2db tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1709 microversion: 2.1 time: 0.335321 Nov 23 04:23:19.848893 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 561/1060] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:19 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1709 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:19.988715 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-570bbca6-04f2-4229-8ec0-690df0a8f950 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:19.996315 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-570bbca6-04f2-4229-8ec0-690df0a8f950 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1277 microversion: 2.1 time: 0.358920 Nov 23 04:23:19.996971 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 500/1061] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:19 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1277 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:20.511008 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-54bc0b45-5d7b-4d83-804f-27018cabaca9 req-d04c7d05-d24d-4688-a47a-a11f86f775cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3425df3-cde6-44d8-8c24-3221f5cd3053", "tag": "f0d43386-0513-4341-9b99-404d03b12ec0"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:23:20.512643 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:23:20.512643 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:23:20.522041 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-54bc0b45-5d7b-4d83-804f-27018cabaca9 req-d04c7d05-d24d-4688-a47a-a11f86f775cd service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:20.522530 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-54bc0b45-5d7b-4d83-804f-27018cabaca9 req-d04c7d05-d24d-4688-a47a-a11f86f775cd service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:20.536701 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-54bc0b45-5d7b-4d83-804f-27018cabaca9 req-d04c7d05-d24d-4688-a47a-a11f86f775cd service nova] Creating event network-changed:f0d43386-0513-4341-9b99-404d03b12ec0 for instance e3425df3-cde6-44d8-8c24-3221f5cd3053 on hv-cinder-76845 Nov 23 04:23:20.541715 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-54bc0b45-5d7b-4d83-804f-27018cabaca9 req-d04c7d05-d24d-4688-a47a-a11f86f775cd service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034325 Nov 23 04:23:20.543048 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 562/1062] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:23:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:23:20.865295 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-90e3a7a6-d3d5-46d7-a9b7-79bc43b5b4ab tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:20.865817 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-90e3a7a6-d3d5-46d7-a9b7-79bc43b5b4ab tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:20.872180 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-90e3a7a6-d3d5-46d7-a9b7-79bc43b5b4ab tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:20.872628 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-90e3a7a6-d3d5-46d7-a9b7-79bc43b5b4ab tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:20.873399 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-90e3a7a6-d3d5-46d7-a9b7-79bc43b5b4ab tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:20.873856 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-90e3a7a6-d3d5-46d7-a9b7-79bc43b5b4ab tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:21.014017 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0f9b8c80-2c1a-4bfd-b4c7-a2a4a3d4a7e6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:21.014779 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0f9b8c80-2c1a-4bfd-b4c7-a2a4a3d4a7e6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:21.020924 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0f9b8c80-2c1a-4bfd-b4c7-a2a4a3d4a7e6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:21.021309 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0f9b8c80-2c1a-4bfd-b4c7-a2a4a3d4a7e6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:21.022100 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0f9b8c80-2c1a-4bfd-b4c7-a2a4a3d4a7e6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:21.022537 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0f9b8c80-2c1a-4bfd-b4c7-a2a4a3d4a7e6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:21.365893 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-90e3a7a6-d3d5-46d7-a9b7-79bc43b5b4ab tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:21.374704 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-90e3a7a6-d3d5-46d7-a9b7-79bc43b5b4ab tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1709 microversion: 2.1 time: 0.512427 Nov 23 04:23:21.381352 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 501/1063] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:20 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1709 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:21.514820 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0f9b8c80-2c1a-4bfd-b4c7-a2a4a3d4a7e6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:21.523959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0f9b8c80-2c1a-4bfd-b4c7-a2a4a3d4a7e6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1265 microversion: 2.1 time: 0.512142 Nov 23 04:23:21.523959 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 563/1064] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:21 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1265 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:22.392637 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4a75919e-a338-4ae5-91ed-aea70f7e6153 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:22.393242 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4a75919e-a338-4ae5-91ed-aea70f7e6153 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:22.399623 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4a75919e-a338-4ae5-91ed-aea70f7e6153 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:22.400077 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4a75919e-a338-4ae5-91ed-aea70f7e6153 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:22.400847 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4a75919e-a338-4ae5-91ed-aea70f7e6153 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:22.401279 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4a75919e-a338-4ae5-91ed-aea70f7e6153 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:22.528910 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4a75919e-a338-4ae5-91ed-aea70f7e6153 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:22.537773 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4a75919e-a338-4ae5-91ed-aea70f7e6153 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1713 microversion: 2.1 time: 0.149358 Nov 23 04:23:22.538332 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 502/1065] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:22 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:22.539468 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-a75cad60-adb8-496a-a07b-db79fe817c0a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:22.540101 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-a75cad60-adb8-496a-a07b-db79fe817c0a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:22.546645 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a75cad60-adb8-496a-a07b-db79fe817c0a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:22.547114 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a75cad60-adb8-496a-a07b-db79fe817c0a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:22.547922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a75cad60-adb8-496a-a07b-db79fe817c0a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:22.548713 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-a75cad60-adb8-496a-a07b-db79fe817c0a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:22.679918 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-a75cad60-adb8-496a-a07b-db79fe817c0a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:22.688602 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-a75cad60-adb8-496a-a07b-db79fe817c0a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1265 microversion: 2.1 time: 0.152725 Nov 23 04:23:22.689264 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 564/1066] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:22 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:23.705298 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-48cb8196-eaa7-4cbe-844e-160371716305 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:23.705912 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-48cb8196-eaa7-4cbe-844e-160371716305 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:23.712244 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-48cb8196-eaa7-4cbe-844e-160371716305 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:23.712694 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-48cb8196-eaa7-4cbe-844e-160371716305 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:23.713505 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-48cb8196-eaa7-4cbe-844e-160371716305 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:23.713946 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-48cb8196-eaa7-4cbe-844e-160371716305 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:23.850059 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-48cb8196-eaa7-4cbe-844e-160371716305 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:23.857278 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-48cb8196-eaa7-4cbe-844e-160371716305 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1265 microversion: 2.1 time: 0.156358 Nov 23 04:23:23.857837 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 503/1067] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:23 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:24.873820 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-76b0a27f-4a87-4d6f-b5f1-3ce30a7e9508 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:24.874436 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-76b0a27f-4a87-4d6f-b5f1-3ce30a7e9508 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:24.881249 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76b0a27f-4a87-4d6f-b5f1-3ce30a7e9508 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:24.885553 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76b0a27f-4a87-4d6f-b5f1-3ce30a7e9508 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:24.885553 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76b0a27f-4a87-4d6f-b5f1-3ce30a7e9508 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:24.885553 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-76b0a27f-4a87-4d6f-b5f1-3ce30a7e9508 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:25.014265 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-76b0a27f-4a87-4d6f-b5f1-3ce30a7e9508 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:25.022816 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-76b0a27f-4a87-4d6f-b5f1-3ce30a7e9508 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1265 microversion: 2.1 time: 0.152862 Nov 23 04:23:25.023419 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 565/1068] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:24 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:26.039812 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b3c7e71a-aefb-4d6d-9326-1a53398d6ee4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:26.040493 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b3c7e71a-aefb-4d6d-9326-1a53398d6ee4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:26.046764 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b3c7e71a-aefb-4d6d-9326-1a53398d6ee4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:26.047764 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b3c7e71a-aefb-4d6d-9326-1a53398d6ee4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:26.048713 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b3c7e71a-aefb-4d6d-9326-1a53398d6ee4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:26.049273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b3c7e71a-aefb-4d6d-9326-1a53398d6ee4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:26.181131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-b3c7e71a-aefb-4d6d-9326-1a53398d6ee4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:26.189137 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b3c7e71a-aefb-4d6d-9326-1a53398d6ee4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1265 microversion: 2.1 time: 0.153046 Nov 23 04:23:26.189692 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 504/1069] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:26 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:27.206491 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4e9eb200-e77a-4b5b-bf87-8c6d542c1ede tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:27.207103 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4e9eb200-e77a-4b5b-bf87-8c6d542c1ede tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:27.213473 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e9eb200-e77a-4b5b-bf87-8c6d542c1ede tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:27.213921 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e9eb200-e77a-4b5b-bf87-8c6d542c1ede tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:27.214693 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e9eb200-e77a-4b5b-bf87-8c6d542c1ede tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:27.215125 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e9eb200-e77a-4b5b-bf87-8c6d542c1ede tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:27.345480 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4e9eb200-e77a-4b5b-bf87-8c6d542c1ede tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:27.352830 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4e9eb200-e77a-4b5b-bf87-8c6d542c1ede tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1265 microversion: 2.1 time: 0.150646 Nov 23 04:23:27.353398 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 566/1070] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:27 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:28.369435 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-84ef408d-235d-4cf2-a174-81f3f2b6158b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:28.370053 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-84ef408d-235d-4cf2-a174-81f3f2b6158b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:28.376531 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-84ef408d-235d-4cf2-a174-81f3f2b6158b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:28.376988 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-84ef408d-235d-4cf2-a174-81f3f2b6158b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:28.377794 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-84ef408d-235d-4cf2-a174-81f3f2b6158b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:28.378239 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-84ef408d-235d-4cf2-a174-81f3f2b6158b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:28.508858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-84ef408d-235d-4cf2-a174-81f3f2b6158b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:28.516740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-84ef408d-235d-4cf2-a174-81f3f2b6158b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1265 microversion: 2.1 time: 0.150953 Nov 23 04:23:28.517305 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 505/1071] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:28 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:29.534788 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5f22bb91-327c-4e88-b966-275b3731418b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:29.535442 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5f22bb91-327c-4e88-b966-275b3731418b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:29.541661 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f22bb91-327c-4e88-b966-275b3731418b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:29.542110 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f22bb91-327c-4e88-b966-275b3731418b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:29.542895 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f22bb91-327c-4e88-b966-275b3731418b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:29.543353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5f22bb91-327c-4e88-b966-275b3731418b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:29.681514 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5f22bb91-327c-4e88-b966-275b3731418b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:29.688938 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5f22bb91-327c-4e88-b966-275b3731418b tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1265 microversion: 2.1 time: 0.159214 Nov 23 04:23:29.689501 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 567/1072] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:29 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:30.706241 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8c23b0a7-cd32-474c-bd4d-d578d998afb9 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:30.706858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8c23b0a7-cd32-474c-bd4d-d578d998afb9 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:30.713140 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8c23b0a7-cd32-474c-bd4d-d578d998afb9 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:30.713588 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8c23b0a7-cd32-474c-bd4d-d578d998afb9 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:30.714366 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8c23b0a7-cd32-474c-bd4d-d578d998afb9 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:30.714803 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8c23b0a7-cd32-474c-bd4d-d578d998afb9 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:30.849966 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8c23b0a7-cd32-474c-bd4d-d578d998afb9 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:30.857323 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8c23b0a7-cd32-474c-bd4d-d578d998afb9 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1265 microversion: 2.1 time: 0.154901 Nov 23 04:23:30.857879 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 506/1073] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:30 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:31.030492 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-78f4ba4e-091c-412d-baaa-a91c43344557 req-771a9963-672f-4f5b-9023-7f9186d958fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3425df3-cde6-44d8-8c24-3221f5cd3053", "name": "network-vif-plugged", "status": "completed", "tag": "f0d43386-0513-4341-9b99-404d03b12ec0"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:23:31.033025 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:23:31.033025 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:23:31.040188 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-78f4ba4e-091c-412d-baaa-a91c43344557 req-771a9963-672f-4f5b-9023-7f9186d958fa service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:31.040626 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-78f4ba4e-091c-412d-baaa-a91c43344557 req-771a9963-672f-4f5b-9023-7f9186d958fa service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:31.051800 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-78f4ba4e-091c-412d-baaa-a91c43344557 req-771a9963-672f-4f5b-9023-7f9186d958fa service nova] Creating event network-vif-plugged:f0d43386-0513-4341-9b99-404d03b12ec0 for instance e3425df3-cde6-44d8-8c24-3221f5cd3053 on hv-cinder-76845 Nov 23 04:23:31.056889 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-78f4ba4e-091c-412d-baaa-a91c43344557 req-771a9963-672f-4f5b-9023-7f9186d958fa service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030001 Nov 23 04:23:31.057469 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 568/1074] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:23:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:23:31.874224 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7e221f87-7206-4596-82de-42252c223c1e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:31.874869 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7e221f87-7206-4596-82de-42252c223c1e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:31.881816 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7e221f87-7206-4596-82de-42252c223c1e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:31.882261 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7e221f87-7206-4596-82de-42252c223c1e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:31.883036 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7e221f87-7206-4596-82de-42252c223c1e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:31.883511 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7e221f87-7206-4596-82de-42252c223c1e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:32.012160 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7e221f87-7206-4596-82de-42252c223c1e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:32.019285 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7e221f87-7206-4596-82de-42252c223c1e tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1265 microversion: 2.1 time: 0.148714 Nov 23 04:23:32.019841 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 507/1075] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:31 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:33.037235 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-42b71da2-c78a-41a5-8f43-e959fd6e60ea tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:33.037953 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-42b71da2-c78a-41a5-8f43-e959fd6e60ea tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:33.043963 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42b71da2-c78a-41a5-8f43-e959fd6e60ea tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:33.044412 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42b71da2-c78a-41a5-8f43-e959fd6e60ea tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:33.045182 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42b71da2-c78a-41a5-8f43-e959fd6e60ea tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:33.045612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-42b71da2-c78a-41a5-8f43-e959fd6e60ea tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:33.180958 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-42b71da2-c78a-41a5-8f43-e959fd6e60ea tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:33.188672 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-42b71da2-c78a-41a5-8f43-e959fd6e60ea tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1453 microversion: 2.1 time: 0.156150 Nov 23 04:23:33.189233 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 569/1076] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:33 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:23:33.205552 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-43523ea8-1fe4-480c-afc9-cd78aae8fb4a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:23:33.206162 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-43523ea8-1fe4-480c-afc9-cd78aae8fb4a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:23:33.212425 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-43523ea8-1fe4-480c-afc9-cd78aae8fb4a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:33.212853 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-43523ea8-1fe4-480c-afc9-cd78aae8fb4a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:33.213655 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-43523ea8-1fe4-480c-afc9-cd78aae8fb4a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:33.214088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-43523ea8-1fe4-480c-afc9-cd78aae8fb4a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:33.353175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-43523ea8-1fe4-480c-afc9-cd78aae8fb4a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:23:33.361651 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-43523ea8-1fe4-480c-afc9-cd78aae8fb4a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1453 microversion: 2.1 time: 0.160437 Nov 23 04:23:33.364089 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 508/1077] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:23:33 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:23:35.332478 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-46cb5efd-302c-400b-84b9-0d83580f8222 req-ab72328d-56f1-479a-847a-fa0991771283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3425df3-cde6-44d8-8c24-3221f5cd3053", "tag": "f0d43386-0513-4341-9b99-404d03b12ec0"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:23:35.333542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:23:35.333542 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:23:35.340800 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-46cb5efd-302c-400b-84b9-0d83580f8222 req-ab72328d-56f1-479a-847a-fa0991771283 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:23:35.341377 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-46cb5efd-302c-400b-84b9-0d83580f8222 req-ab72328d-56f1-479a-847a-fa0991771283 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:23:35.352576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-46cb5efd-302c-400b-84b9-0d83580f8222 req-ab72328d-56f1-479a-847a-fa0991771283 service nova] Creating event network-changed:f0d43386-0513-4341-9b99-404d03b12ec0 for instance e3425df3-cde6-44d8-8c24-3221f5cd3053 on hv-cinder-76845 Nov 23 04:23:35.357517 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-46cb5efd-302c-400b-84b9-0d83580f8222 req-ab72328d-56f1-479a-847a-fa0991771283 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029112 Nov 23 04:23:35.358297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 570/1078] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:23:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:24:00.940095 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0ae4d770-f3c3-4890-9425-fcbb2f4299c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:00.940691 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0ae4d770-f3c3-4890-9425-fcbb2f4299c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:00.946508 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0ae4d770-f3c3-4890-9425-fcbb2f4299c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:00.947195 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0ae4d770-f3c3-4890-9425-fcbb2f4299c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:00.948000 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0ae4d770-f3c3-4890-9425-fcbb2f4299c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:00.948694 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0ae4d770-f3c3-4890-9425-fcbb2f4299c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:01.026486 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-0ae4d770-f3c3-4890-9425-fcbb2f4299c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lazy-loading 'services' on Instance uuid 50329b3a-4863-4a29-92f9-e05c525f1435 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:24:01.280298 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0ae4d770-f3c3-4890-9425-fcbb2f4299c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "DELETE /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/os-volume_attachments/fa0cb0ae-0e74-4763-83f3-58aacad48411" status: 202 len: 0 microversion: 2.1 time: 0.344715 Nov 23 04:24:01.280902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 509/1079] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:24:00 2021] DELETE /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/os-volume_attachments/fa0cb0ae-0e74-4763-83f3-58aacad48411 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:24:02.391235 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f71d4784-e01b-4420-bade-24d037d8359a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:24:02.397961 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f71d4784-e01b-4420-bade-24d037d8359a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:02.398471 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-f71d4784-e01b-4420-bade-24d037d8359a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:02.420904 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f71d4784-e01b-4420-bade-24d037d8359a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Going to try to stop instance {{(pid=116836) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 23 04:24:02.609489 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f71d4784-e01b-4420-bade-24d037d8359a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 202 len: 0 microversion: 2.1 time: 0.222020 Nov 23 04:24:02.610174 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 571/1080] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:24:02 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:24:02.618983 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4bf4302c-fb04-4b14-befd-cfbbfb1c5950 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:02.619745 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4bf4302c-fb04-4b14-befd-cfbbfb1c5950 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:02.626083 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bf4302c-fb04-4b14-befd-cfbbfb1c5950 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:02.626564 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bf4302c-fb04-4b14-befd-cfbbfb1c5950 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:02.627356 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bf4302c-fb04-4b14-befd-cfbbfb1c5950 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:02.627803 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4bf4302c-fb04-4b14-befd-cfbbfb1c5950 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:02.758750 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-4bf4302c-fb04-4b14-befd-cfbbfb1c5950 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:02.766072 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4bf4302c-fb04-4b14-befd-cfbbfb1c5950 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1677 microversion: 2.1 time: 0.151374 Nov 23 04:24:02.766633 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 510/1081] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:02 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:03.783900 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2f1d3984-743c-4155-bc87-928b3a5a9b61 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:03.784590 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2f1d3984-743c-4155-bc87-928b3a5a9b61 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:03.791185 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f1d3984-743c-4155-bc87-928b3a5a9b61 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:03.791659 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f1d3984-743c-4155-bc87-928b3a5a9b61 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:03.792426 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f1d3984-743c-4155-bc87-928b3a5a9b61 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:03.792858 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f1d3984-743c-4155-bc87-928b3a5a9b61 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:03.924395 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2f1d3984-743c-4155-bc87-928b3a5a9b61 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:03.931808 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2f1d3984-743c-4155-bc87-928b3a5a9b61 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1677 microversion: 2.1 time: 0.152130 Nov 23 04:24:03.932305 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 572/1082] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:03 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:04.949422 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2ffd28d2-9608-44e8-8f22-5f6d37ef4868 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:04.949957 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2ffd28d2-9608-44e8-8f22-5f6d37ef4868 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:04.956693 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2ffd28d2-9608-44e8-8f22-5f6d37ef4868 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:04.957134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2ffd28d2-9608-44e8-8f22-5f6d37ef4868 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:04.957911 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2ffd28d2-9608-44e8-8f22-5f6d37ef4868 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:04.958345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2ffd28d2-9608-44e8-8f22-5f6d37ef4868 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:05.091285 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2ffd28d2-9608-44e8-8f22-5f6d37ef4868 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:05.099169 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2ffd28d2-9608-44e8-8f22-5f6d37ef4868 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1677 microversion: 2.1 time: 0.153456 Nov 23 04:24:05.099748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 511/1083] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:04 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:06.116659 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-94cfbfac-4597-49ca-ab20-15e143cf2a1f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:06.117281 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-94cfbfac-4597-49ca-ab20-15e143cf2a1f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:06.123782 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-94cfbfac-4597-49ca-ab20-15e143cf2a1f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:06.124290 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-94cfbfac-4597-49ca-ab20-15e143cf2a1f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:06.125071 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-94cfbfac-4597-49ca-ab20-15e143cf2a1f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:06.125511 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-94cfbfac-4597-49ca-ab20-15e143cf2a1f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:06.255710 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-94cfbfac-4597-49ca-ab20-15e143cf2a1f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:06.263070 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-94cfbfac-4597-49ca-ab20-15e143cf2a1f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1677 microversion: 2.1 time: 0.150913 Nov 23 04:24:06.263655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 573/1084] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:06 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:07.279763 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-09436d6e-04d1-4ae9-8385-4fa9128b7eb1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:07.280377 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-09436d6e-04d1-4ae9-8385-4fa9128b7eb1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:07.287012 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-09436d6e-04d1-4ae9-8385-4fa9128b7eb1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:07.287515 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-09436d6e-04d1-4ae9-8385-4fa9128b7eb1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:07.288295 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-09436d6e-04d1-4ae9-8385-4fa9128b7eb1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:07.288734 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-09436d6e-04d1-4ae9-8385-4fa9128b7eb1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:07.427132 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-09436d6e-04d1-4ae9-8385-4fa9128b7eb1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:07.434421 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-09436d6e-04d1-4ae9-8385-4fa9128b7eb1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1677 microversion: 2.1 time: 0.158288 Nov 23 04:24:07.434980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 512/1085] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:07 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:08.450665 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-405c4998-a931-4a8e-bc96-27ffb83c08a3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:08.451295 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-405c4998-a931-4a8e-bc96-27ffb83c08a3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:08.458137 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-405c4998-a931-4a8e-bc96-27ffb83c08a3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:08.458603 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-405c4998-a931-4a8e-bc96-27ffb83c08a3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:08.459428 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-405c4998-a931-4a8e-bc96-27ffb83c08a3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:08.459868 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-405c4998-a931-4a8e-bc96-27ffb83c08a3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:08.589008 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-405c4998-a931-4a8e-bc96-27ffb83c08a3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:08.596218 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-405c4998-a931-4a8e-bc96-27ffb83c08a3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1677 microversion: 2.1 time: 0.149187 Nov 23 04:24:08.596776 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 574/1086] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:08 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:09.612805 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fbf2978a-91ea-44fc-88f5-e53179173949 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:09.613415 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fbf2978a-91ea-44fc-88f5-e53179173949 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:09.619363 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fbf2978a-91ea-44fc-88f5-e53179173949 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:09.619808 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fbf2978a-91ea-44fc-88f5-e53179173949 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:09.620577 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fbf2978a-91ea-44fc-88f5-e53179173949 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:09.621012 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fbf2978a-91ea-44fc-88f5-e53179173949 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:09.748846 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-fbf2978a-91ea-44fc-88f5-e53179173949 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:09.756787 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fbf2978a-91ea-44fc-88f5-e53179173949 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1677 microversion: 2.1 time: 0.147588 Nov 23 04:24:09.757342 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 513/1087] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:09 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:10.774037 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1ca3550b-5ff2-47b8-935c-ff41d82b973d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:10.774636 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1ca3550b-5ff2-47b8-935c-ff41d82b973d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:10.780415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1ca3550b-5ff2-47b8-935c-ff41d82b973d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:10.780857 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1ca3550b-5ff2-47b8-935c-ff41d82b973d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:10.781621 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1ca3550b-5ff2-47b8-935c-ff41d82b973d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:10.782301 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1ca3550b-5ff2-47b8-935c-ff41d82b973d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:10.912664 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1ca3550b-5ff2-47b8-935c-ff41d82b973d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:10.920055 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1ca3550b-5ff2-47b8-935c-ff41d82b973d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1677 microversion: 2.1 time: 0.150403 Nov 23 04:24:10.920620 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 575/1088] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:10 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:11.937202 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ff354dfa-5ef8-4cbd-9542-02ccbd2794a5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:11.937747 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ff354dfa-5ef8-4cbd-9542-02ccbd2794a5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:11.944423 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff354dfa-5ef8-4cbd-9542-02ccbd2794a5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:11.944898 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff354dfa-5ef8-4cbd-9542-02ccbd2794a5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:11.945663 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff354dfa-5ef8-4cbd-9542-02ccbd2794a5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:11.946101 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ff354dfa-5ef8-4cbd-9542-02ccbd2794a5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:12.076938 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ff354dfa-5ef8-4cbd-9542-02ccbd2794a5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:12.084330 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ff354dfa-5ef8-4cbd-9542-02ccbd2794a5 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1677 microversion: 2.1 time: 0.150759 Nov 23 04:24:12.084890 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 514/1089] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:11 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:13.101009 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6c65f3d0-9cba-48a5-aed1-1c34e2ac8e8b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:13.101621 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6c65f3d0-9cba-48a5-aed1-1c34e2ac8e8b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:13.107849 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6c65f3d0-9cba-48a5-aed1-1c34e2ac8e8b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:13.110869 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6c65f3d0-9cba-48a5-aed1-1c34e2ac8e8b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:13.110869 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6c65f3d0-9cba-48a5-aed1-1c34e2ac8e8b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:13.110869 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6c65f3d0-9cba-48a5-aed1-1c34e2ac8e8b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:13.241219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6c65f3d0-9cba-48a5-aed1-1c34e2ac8e8b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:13.248373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6c65f3d0-9cba-48a5-aed1-1c34e2ac8e8b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1677 microversion: 2.1 time: 0.151731 Nov 23 04:24:13.248935 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 576/1090] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:13 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:14.265344 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f3bce6cf-343c-4f3b-99f2-e10ea97fc3ee tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:14.265959 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f3bce6cf-343c-4f3b-99f2-e10ea97fc3ee tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:14.272293 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f3bce6cf-343c-4f3b-99f2-e10ea97fc3ee tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:14.272791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f3bce6cf-343c-4f3b-99f2-e10ea97fc3ee tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:14.273588 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f3bce6cf-343c-4f3b-99f2-e10ea97fc3ee tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:14.274031 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f3bce6cf-343c-4f3b-99f2-e10ea97fc3ee tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:14.406316 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f3bce6cf-343c-4f3b-99f2-e10ea97fc3ee tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:14.414912 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f3bce6cf-343c-4f3b-99f2-e10ea97fc3ee tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1654 microversion: 2.1 time: 0.153309 Nov 23 04:24:14.415526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 515/1091] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:14 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:14.431519 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-85594639-f7ca-4536-8630-e3492635d228 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:24:14.437861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-85594639-f7ca-4536-8630-e3492635d228 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:14.438310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-85594639-f7ca-4536-8630-e3492635d228 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:14.459494 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-85594639-f7ca-4536-8630-e3492635d228 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Going to try to start instance {{(pid=116836) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 23 04:24:14.620964 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-85594639-f7ca-4536-8630-e3492635d228 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action" status: 202 len: 0 microversion: 2.1 time: 0.192785 Nov 23 04:24:14.621476 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 577/1092] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:24:14 2021] POST /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:24:14.629436 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-69948a8b-fb06-4124-a5a7-a4c23e5c504d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:14.630484 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-69948a8b-fb06-4124-a5a7-a4c23e5c504d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:14.636308 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-69948a8b-fb06-4124-a5a7-a4c23e5c504d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:14.636756 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-69948a8b-fb06-4124-a5a7-a4c23e5c504d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:14.637538 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-69948a8b-fb06-4124-a5a7-a4c23e5c504d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:14.637979 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-69948a8b-fb06-4124-a5a7-a4c23e5c504d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:14.774813 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-69948a8b-fb06-4124-a5a7-a4c23e5c504d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:14.782452 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-69948a8b-fb06-4124-a5a7-a4c23e5c504d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1663 microversion: 2.1 time: 0.156309 Nov 23 04:24:14.783027 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 516/1093] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:14 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:24:15.801015 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7587cefd-4df1-4f4c-b491-d83f341907de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:15.802446 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7587cefd-4df1-4f4c-b491-d83f341907de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:15.808480 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7587cefd-4df1-4f4c-b491-d83f341907de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:15.816336 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7587cefd-4df1-4f4c-b491-d83f341907de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:15.816336 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7587cefd-4df1-4f4c-b491-d83f341907de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:15.816336 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7587cefd-4df1-4f4c-b491-d83f341907de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:16.268896 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-7587cefd-4df1-4f4c-b491-d83f341907de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:16.277099 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7587cefd-4df1-4f4c-b491-d83f341907de tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1663 microversion: 2.1 time: 0.480728 Nov 23 04:24:16.277657 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 578/1094] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:15 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1663 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:17.294865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6d424ddb-0000-4eac-902c-0561c142ac9f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:17.295537 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6d424ddb-0000-4eac-902c-0561c142ac9f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:17.302434 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6d424ddb-0000-4eac-902c-0561c142ac9f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:17.302887 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6d424ddb-0000-4eac-902c-0561c142ac9f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:17.303700 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6d424ddb-0000-4eac-902c-0561c142ac9f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:17.304139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6d424ddb-0000-4eac-902c-0561c142ac9f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:17.432687 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6d424ddb-0000-4eac-902c-0561c142ac9f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:17.439949 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6d424ddb-0000-4eac-902c-0561c142ac9f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1667 microversion: 2.1 time: 0.148737 Nov 23 04:24:17.440510 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 517/1095] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:17 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1667 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:36.338134 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ae0309f5-2bed-4f69-9bf8-eef1b5f2a23f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:36.338677 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ae0309f5-2bed-4f69-9bf8-eef1b5f2a23f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:36.340625 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-651c6dfb-26e7-43bd-a03f-129cc1ea9773 req-5748f625-ede6-4064-a2c7-9267aad1a5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe99c22a-d75b-4a5c-8800-6a65d64ded71", "tag": "6785c855-b933-47d9-95d0-982e7c07f503"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:24:36.342389 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:24:36.342389 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:24:36.345297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae0309f5-2bed-4f69-9bf8-eef1b5f2a23f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:36.346076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae0309f5-2bed-4f69-9bf8-eef1b5f2a23f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:36.346712 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae0309f5-2bed-4f69-9bf8-eef1b5f2a23f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:36.347240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ae0309f5-2bed-4f69-9bf8-eef1b5f2a23f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:36.349597 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-651c6dfb-26e7-43bd-a03f-129cc1ea9773 req-5748f625-ede6-4064-a2c7-9267aad1a5ae service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:36.350026 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-651c6dfb-26e7-43bd-a03f-129cc1ea9773 req-5748f625-ede6-4064-a2c7-9267aad1a5ae service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:36.362002 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-651c6dfb-26e7-43bd-a03f-129cc1ea9773 req-5748f625-ede6-4064-a2c7-9267aad1a5ae service nova] Creating event network-changed:6785c855-b933-47d9-95d0-982e7c07f503 for instance fe99c22a-d75b-4a5c-8800-6a65d64ded71 on hv-cinder-76845 Nov 23 04:24:36.367603 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-651c6dfb-26e7-43bd-a03f-129cc1ea9773 req-5748f625-ede6-4064-a2c7-9267aad1a5ae service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030151 Nov 23 04:24:36.368427 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 518/1096] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:24:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:24:36.374123 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ae0309f5-2bed-4f69-9bf8-eef1b5f2a23f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:24:36.572054 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ae0309f5-2bed-4f69-9bf8-eef1b5f2a23f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "DELETE /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 204 len: 0 microversion: 2.1 time: 0.237555 Nov 23 04:24:36.572867 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 579/1097] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:24:36 2021] DELETE /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:24:36.581110 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-519f7b78-9bad-489f-a1fd-2147a4b6ab9a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:36.581807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-519f7b78-9bad-489f-a1fd-2147a4b6ab9a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:36.588131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-519f7b78-9bad-489f-a1fd-2147a4b6ab9a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:36.588581 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-519f7b78-9bad-489f-a1fd-2147a4b6ab9a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:36.589360 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-519f7b78-9bad-489f-a1fd-2147a4b6ab9a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:36.589794 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-519f7b78-9bad-489f-a1fd-2147a4b6ab9a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:36.830754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-519f7b78-9bad-489f-a1fd-2147a4b6ab9a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:36.839661 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-519f7b78-9bad-489f-a1fd-2147a4b6ab9a tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1567 microversion: 2.1 time: 0.262483 Nov 23 04:24:36.840242 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 519/1098] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:36 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:37.858270 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0eb21a77-b213-4bfa-93b4-30d1ef9ed538 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:37.858958 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0eb21a77-b213-4bfa-93b4-30d1ef9ed538 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:37.865158 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0eb21a77-b213-4bfa-93b4-30d1ef9ed538 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:37.865607 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0eb21a77-b213-4bfa-93b4-30d1ef9ed538 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:37.866379 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0eb21a77-b213-4bfa-93b4-30d1ef9ed538 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:37.866857 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0eb21a77-b213-4bfa-93b4-30d1ef9ed538 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:38.002499 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0eb21a77-b213-4bfa-93b4-30d1ef9ed538 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:38.009969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0eb21a77-b213-4bfa-93b4-30d1ef9ed538 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1449 microversion: 2.1 time: 0.155715 Nov 23 04:24:38.010567 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 580/1099] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:37 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:39.028260 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-7692ecf9-efdc-49e0-b3e0-5f94b225fa3b req-60c85cd2-f5b4-42d3-a175-40cbdcd30f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe99c22a-d75b-4a5c-8800-6a65d64ded71", "name": "network-vif-deleted", "tag": "6785c855-b933-47d9-95d0-982e7c07f503"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:24:39.029866 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:24:39.029866 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:24:39.030996 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-50171c48-177a-47de-87b5-f3ea6f85dd1f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:39.032531 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-50171c48-177a-47de-87b5-f3ea6f85dd1f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:39.037089 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-7692ecf9-efdc-49e0-b3e0-5f94b225fa3b req-60c85cd2-f5b4-42d3-a175-40cbdcd30f87 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:39.043120 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-7692ecf9-efdc-49e0-b3e0-5f94b225fa3b req-60c85cd2-f5b4-42d3-a175-40cbdcd30f87 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:39.043297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-50171c48-177a-47de-87b5-f3ea6f85dd1f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:39.043297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-50171c48-177a-47de-87b5-f3ea6f85dd1f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:39.043297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-50171c48-177a-47de-87b5-f3ea6f85dd1f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:39.043297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-50171c48-177a-47de-87b5-f3ea6f85dd1f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:39.050134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-7692ecf9-efdc-49e0-b3e0-5f94b225fa3b req-60c85cd2-f5b4-42d3-a175-40cbdcd30f87 service nova] Creating event network-vif-deleted:6785c855-b933-47d9-95d0-982e7c07f503 for instance fe99c22a-d75b-4a5c-8800-6a65d64ded71 on hv-cinder-76845 Nov 23 04:24:39.056657 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-7692ecf9-efdc-49e0-b3e0-5f94b225fa3b req-60c85cd2-f5b4-42d3-a175-40cbdcd30f87 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032982 Nov 23 04:24:39.057261 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 520/1100] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:24:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:24:39.106071 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-50171c48-177a-47de-87b5-f3ea6f85dd1f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:39.113369 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-50171c48-177a-47de-87b5-f3ea6f85dd1f tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1382 microversion: 2.1 time: 0.089355 Nov 23 04:24:39.113929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 581/1101] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:39 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1382 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:24:40.130813 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:40.131531 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:40.138638 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:40.139085 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:40.139949 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:40.140380 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:40.170798 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:40.171277 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:40.171728 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lazy-loading 'fault' on Instance uuid fe99c22a-d75b-4a5c-8800-6a65d64ded71 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:24:40.214767 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '153a38363b5c4a2588ee3d43b8475342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29832a113f1544d7a5467a88b2f0d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:40.222114 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-50395a05-c6d1-417d-b66e-41d9eb43da24 tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 200 len: 1223 microversion: 2.1 time: 0.095397 Nov 23 04:24:40.223878 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 521/1102] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:40 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:24:41.238451 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e7d1fa06-fa68-4aaa-a36d-dcc23a75037d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:41.239064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e7d1fa06-fa68-4aaa-a36d-dcc23a75037d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] [instance: fe99c22a-d75b-4a5c-8800-6a65d64ded71] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:41.245619 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e7d1fa06-fa68-4aaa-a36d-dcc23a75037d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:41.246072 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e7d1fa06-fa68-4aaa-a36d-dcc23a75037d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:41.246887 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e7d1fa06-fa68-4aaa-a36d-dcc23a75037d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:41.247357 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e7d1fa06-fa68-4aaa-a36d-dcc23a75037d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:41.260710 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-e7d1fa06-fa68-4aaa-a36d-dcc23a75037d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] HTTP exception thrown: Instance fe99c22a-d75b-4a5c-8800-6a65d64ded71 could not be found. Nov 23 04:24:41.261293 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e7d1fa06-fa68-4aaa-a36d-dcc23a75037d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Returning 404 to user: Instance fe99c22a-d75b-4a5c-8800-6a65d64ded71 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:24:41.262101 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e7d1fa06-fa68-4aaa-a36d-dcc23a75037d tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71" status: 404 len: 111 microversion: 2.1 time: 0.027477 Nov 23 04:24:41.262648 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 582/1103] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:41 2021] GET /compute/v2.1/servers/fe99c22a-d75b-4a5c-8800-6a65d64ded71 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:24:41.485147 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0ec5873b-b0f1-445b-af4a-59e5da89e8ef tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] Calling method '.version_select at 0x7fa7ddea30d0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:41.572771 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0ec5873b-b0f1-445b-af4a-59e5da89e8ef tempest-TestShelveInstance-875834951 tempest-TestShelveInstance-875834951-project] 10.222.0.54 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-303250207" status: 202 len: 0 microversion: 2.1 time: 0.091228 Nov 23 04:24:41.573346 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 522/1104] 10.222.0.54 () {58 vars in 1250 bytes} [Tue Nov 23 04:24:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-303250207 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:24:50.022407 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-645f25e1-73ba-4a18-ac8b-5fd817e9e25b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:50.023440 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-645f25e1-73ba-4a18-ac8b-5fd817e9e25b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:50.029698 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-645f25e1-73ba-4a18-ac8b-5fd817e9e25b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:50.030146 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-645f25e1-73ba-4a18-ac8b-5fd817e9e25b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:50.030927 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-645f25e1-73ba-4a18-ac8b-5fd817e9e25b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:50.031647 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-645f25e1-73ba-4a18-ac8b-5fd817e9e25b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:50.061750 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-645f25e1-73ba-4a18-ac8b-5fd817e9e25b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043061 Nov 23 04:24:50.066163 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 583/1105] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:24:50 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:24:50.122450 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1d206a20-3a4e-411d-ae33-c2e26397c725 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:50.122962 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1d206a20-3a4e-411d-ae33-c2e26397c725 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:50.129358 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1d206a20-3a4e-411d-ae33-c2e26397c725 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:50.129802 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1d206a20-3a4e-411d-ae33-c2e26397c725 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:50.130571 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1d206a20-3a4e-411d-ae33-c2e26397c725 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:50.131005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1d206a20-3a4e-411d-ae33-c2e26397c725 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:50.155881 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1d206a20-3a4e-411d-ae33-c2e26397c725 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Going to try to terminate instance {{(pid=116837) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:24:50.491619 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1d206a20-3a4e-411d-ae33-c2e26397c725 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "DELETE /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 204 len: 0 microversion: 2.1 time: 0.373017 Nov 23 04:24:50.492416 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 523/1106] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:24:50 2021] DELETE /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:24:50.501004 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-88008928-7feb-4776-b62a-ab0383b2411f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:50.501612 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-88008928-7feb-4776-b62a-ab0383b2411f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:50.507515 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-88008928-7feb-4776-b62a-ab0383b2411f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:50.507964 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-88008928-7feb-4776-b62a-ab0383b2411f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:50.509468 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-88008928-7feb-4776-b62a-ab0383b2411f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:50.509905 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-88008928-7feb-4776-b62a-ab0383b2411f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:50.638920 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-88008928-7feb-4776-b62a-ab0383b2411f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:50.646156 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-88008928-7feb-4776-b62a-ab0383b2411f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1673 microversion: 2.1 time: 0.148993 Nov 23 04:24:50.646705 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 584/1107] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:50 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:24:51.663650 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-cbeceb6d-2ff4-4724-be58-5aa7db536f00 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:51.664352 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-cbeceb6d-2ff4-4724-be58-5aa7db536f00 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:51.670650 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cbeceb6d-2ff4-4724-be58-5aa7db536f00 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:51.671103 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cbeceb6d-2ff4-4724-be58-5aa7db536f00 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:51.671923 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cbeceb6d-2ff4-4724-be58-5aa7db536f00 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:51.672361 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cbeceb6d-2ff4-4724-be58-5aa7db536f00 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:51.805149 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-cbeceb6d-2ff4-4724-be58-5aa7db536f00 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:51.812686 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-cbeceb6d-2ff4-4724-be58-5aa7db536f00 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1673 microversion: 2.1 time: 0.153075 Nov 23 04:24:51.813244 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 524/1108] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:51 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:52.830111 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5793c0de-ca19-4f83-b347-1bf9b7e439ac tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:52.830646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5793c0de-ca19-4f83-b347-1bf9b7e439ac tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:52.837258 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5793c0de-ca19-4f83-b347-1bf9b7e439ac tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:52.837706 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5793c0de-ca19-4f83-b347-1bf9b7e439ac tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:52.838492 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5793c0de-ca19-4f83-b347-1bf9b7e439ac tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:52.838925 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5793c0de-ca19-4f83-b347-1bf9b7e439ac tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:53.067644 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5793c0de-ca19-4f83-b347-1bf9b7e439ac tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:53.075442 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5793c0de-ca19-4f83-b347-1bf9b7e439ac tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1673 microversion: 2.1 time: 0.248944 Nov 23 04:24:53.076010 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 585/1109] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:52 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:53.670384 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-04ce117b-cc08-4e97-ae5b-e238319bd308 req-8341e893-b0a1-4570-b453-029d46a83059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50329b3a-4863-4a29-92f9-e05c525f1435", "name": "network-vif-deleted", "tag": "0429849c-9408-4787-ae74-907d8a990dda"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:24:53.672908 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:24:53.672908 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:24:53.689429 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-04ce117b-cc08-4e97-ae5b-e238319bd308 req-8341e893-b0a1-4570-b453-029d46a83059 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:53.690288 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-04ce117b-cc08-4e97-ae5b-e238319bd308 req-8341e893-b0a1-4570-b453-029d46a83059 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:53.704222 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-04ce117b-cc08-4e97-ae5b-e238319bd308 req-8341e893-b0a1-4570-b453-029d46a83059 service nova] Creating event network-vif-deleted:0429849c-9408-4787-ae74-907d8a990dda for instance 50329b3a-4863-4a29-92f9-e05c525f1435 on hv-cinder-76845 Nov 23 04:24:53.709310 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-04ce117b-cc08-4e97-ae5b-e238319bd308 req-8341e893-b0a1-4570-b453-029d46a83059 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237693 Nov 23 04:24:53.710278 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 525/1110] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:24:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:24:54.092368 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:54.092971 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:54.099178 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:54.099652 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:54.100659 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:54.101261 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:54.135805 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:54.136276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:54.136725 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lazy-loading 'fault' on Instance uuid 50329b3a-4863-4a29-92f9-e05c525f1435 {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:24:54.178417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:54.186401 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-53cfa19d-89fb-40f4-b326-97676436db59 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 200 len: 1328 microversion: 2.1 time: 0.097651 Nov 23 04:24:54.186984 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 586/1111] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:54 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:55.204081 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4d45c4bc-f1bb-4063-93d1-55c395acc746 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:55.204776 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4d45c4bc-f1bb-4063-93d1-55c395acc746 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:55.211438 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d45c4bc-f1bb-4063-93d1-55c395acc746 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:55.212437 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d45c4bc-f1bb-4063-93d1-55c395acc746 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:55.213224 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d45c4bc-f1bb-4063-93d1-55c395acc746 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:55.213766 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d45c4bc-f1bb-4063-93d1-55c395acc746 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:55.227185 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-4d45c4bc-f1bb-4063-93d1-55c395acc746 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] HTTP exception thrown: Instance 50329b3a-4863-4a29-92f9-e05c525f1435 could not be found. Nov 23 04:24:55.228438 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4d45c4bc-f1bb-4063-93d1-55c395acc746 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Returning 404 to user: Instance 50329b3a-4863-4a29-92f9-e05c525f1435 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:24:55.229273 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4d45c4bc-f1bb-4063-93d1-55c395acc746 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 404 len: 111 microversion: 2.1 time: 0.029284 Nov 23 04:24:55.229814 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 526/1112] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:55 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:24:55.237760 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b39eb9ff-a963-4b93-a030-8c07185cb29a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '.version_select at 0x7fa7dd68be50>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:55.361581 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b39eb9ff-a963-4b93-a030-8c07185cb29a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764092527" status: 202 len: 0 microversion: 2.1 time: 0.127168 Nov 23 04:24:55.362089 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 587/1113] 10.222.0.54 () {58 vars in 1220 bytes} [Tue Nov 23 04:24:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1764092527 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:24:56.158096 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6122ff20-0d2f-4177-a511-65d14a71bda0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'create', calling method: .version_select at 0x7fa7dde929d0>, body: {"keypair": {"name": "tempest-keypair-1902574859"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:24:56.172310 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-6122ff20-0d2f-4177-a511-65d14a71bda0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'key_pairs'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:24:56.176085 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-6122ff20-0d2f-4177-a511-65d14a71bda0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for user ca8923a30e7b4b6b9b3c2eef472c2117 and project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'key_pairs'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:24:56.442853 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-6122ff20-0d2f-4177-a511-65d14a71bda0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'key_pairs'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:24:56.446865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-6122ff20-0d2f-4177-a511-65d14a71bda0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for user ca8923a30e7b4b6b9b3c2eef472c2117 and project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'key_pairs'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:24:56.459230 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6122ff20-0d2f-4177-a511-65d14a71bda0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.305152 Nov 23 04:24:56.459886 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 527/1114] 10.222.0.54 () {60 vars in 1157 bytes} [Tue Nov 23 04:24:56 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:24:58.555157 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-170827229", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d75cfc86-e875-4aa3-9237-5714df0b6f5c"}], "security_groups": [{"name": "tempest-securitygroup--1693364249"}], "key_name": "tempest-keypair-1902574859", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:24:58.655439 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] validate_networks() for [('d75cfc86-e875-4aa3-9237-5714df0b6f5c', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:24:59.029829 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:24:59.030246 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:24:59.030711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:24:59.031404 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:24:59.031811 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:24:59.040855 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:59.041301 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:59.042130 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:24:59.042561 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:24:59.058579 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:24:59.062305 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Getting quotas for user ca8923a30e7b4b6b9b3c2eef472c2117 and project ed6fa4f03d864e43be8dc7eec4c89213. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:24:59.072988 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:24:59.075336 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:24:59.196210 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3105f086-7bcc-4799-9b67-42bfb86313bf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.645448 Nov 23 04:24:59.196853 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 588/1115] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:24:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:24:59.207484 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2156829c-6b6f-4deb-935a-ba46e29bb4f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:24:59.208097 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2156829c-6b6f-4deb-935a-ba46e29bb4f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:24:59.266534 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2156829c-6b6f-4deb-935a-ba46e29bb4f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:24:59.274753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2156829c-6b6f-4deb-935a-ba46e29bb4f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1237 microversion: 2.1 time: 0.069784 Nov 23 04:24:59.274753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 528/1116] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:24:59 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:00.291073 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4e9647d7-64db-416b-86c9-07aabf96c6ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:00.291700 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4e9647d7-64db-416b-86c9-07aabf96c6ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:00.298634 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e9647d7-64db-416b-86c9-07aabf96c6ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:00.299080 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e9647d7-64db-416b-86c9-07aabf96c6ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:00.299995 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e9647d7-64db-416b-86c9-07aabf96c6ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:00.300433 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4e9647d7-64db-416b-86c9-07aabf96c6ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:00.362983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4e9647d7-64db-416b-86c9-07aabf96c6ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:00.371417 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4e9647d7-64db-416b-86c9-07aabf96c6ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1241 microversion: 2.1 time: 0.084950 Nov 23 04:25:00.376386 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 589/1117] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:00 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:01.388380 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ffa6e025-747f-4874-a6be-4ce00c6e2f34 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:01.389119 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ffa6e025-747f-4874-a6be-4ce00c6e2f34 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:01.395465 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ffa6e025-747f-4874-a6be-4ce00c6e2f34 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:01.395920 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ffa6e025-747f-4874-a6be-4ce00c6e2f34 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:01.396717 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ffa6e025-747f-4874-a6be-4ce00c6e2f34 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:01.397158 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ffa6e025-747f-4874-a6be-4ce00c6e2f34 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:01.471854 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ffa6e025-747f-4874-a6be-4ce00c6e2f34 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:01.479939 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ffa6e025-747f-4874-a6be-4ce00c6e2f34 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1297 microversion: 2.1 time: 0.095767 Nov 23 04:25:01.480519 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 529/1118] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:01 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:02.497739 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6e004b44-0185-44eb-a439-88e80874c9c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:02.498356 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6e004b44-0185-44eb-a439-88e80874c9c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:02.504769 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e004b44-0185-44eb-a439-88e80874c9c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:02.505223 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e004b44-0185-44eb-a439-88e80874c9c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:02.506011 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e004b44-0185-44eb-a439-88e80874c9c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:02.506448 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e004b44-0185-44eb-a439-88e80874c9c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:02.714804 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-6e004b44-0185-44eb-a439-88e80874c9c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:02.722188 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6e004b44-0185-44eb-a439-88e80874c9c8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.229096 Nov 23 04:25:02.722744 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 590/1119] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:02 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:03.363590 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-c79d2b5e-5738-4530-92a6-bb0934613fc5 req-9d362062-4ec8-4fdf-9861-9dadbf05b6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d615b0-693e-47d1-932a-7dfc14f285bb", "tag": "a7c27a4c-3412-4b38-ad6e-7fd5f0d99fb9"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:03.365412 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:25:03.365412 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:25:03.374238 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-c79d2b5e-5738-4530-92a6-bb0934613fc5 req-9d362062-4ec8-4fdf-9861-9dadbf05b6a9 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:03.374868 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-c79d2b5e-5738-4530-92a6-bb0934613fc5 req-9d362062-4ec8-4fdf-9861-9dadbf05b6a9 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:03.394625 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-c79d2b5e-5738-4530-92a6-bb0934613fc5 req-9d362062-4ec8-4fdf-9861-9dadbf05b6a9 service nova] Creating event network-changed:a7c27a4c-3412-4b38-ad6e-7fd5f0d99fb9 for instance 47d615b0-693e-47d1-932a-7dfc14f285bb on hv-cinder-76845 Nov 23 04:25:03.401076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-c79d2b5e-5738-4530-92a6-bb0934613fc5 req-9d362062-4ec8-4fdf-9861-9dadbf05b6a9 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041910 Nov 23 04:25:03.402366 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 530/1120] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:25:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:25:03.738764 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-27b7e370-da12-4723-a16c-6c9e5b96c62c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:03.739400 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-27b7e370-da12-4723-a16c-6c9e5b96c62c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:03.745746 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27b7e370-da12-4723-a16c-6c9e5b96c62c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:03.746198 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27b7e370-da12-4723-a16c-6c9e5b96c62c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:03.746985 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27b7e370-da12-4723-a16c-6c9e5b96c62c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:03.747449 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-27b7e370-da12-4723-a16c-6c9e5b96c62c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:04.105044 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-27b7e370-da12-4723-a16c-6c9e5b96c62c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:04.112244 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-27b7e370-da12-4723-a16c-6c9e5b96c62c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.377034 Nov 23 04:25:04.112744 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 591/1121] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:03 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:05.129795 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0ec7e81c-2f70-498f-ac3e-2d31db4c2fec tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:05.130489 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0ec7e81c-2f70-498f-ac3e-2d31db4c2fec tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:05.136840 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0ec7e81c-2f70-498f-ac3e-2d31db4c2fec tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:05.137294 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0ec7e81c-2f70-498f-ac3e-2d31db4c2fec tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:05.138070 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0ec7e81c-2f70-498f-ac3e-2d31db4c2fec tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:05.138510 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0ec7e81c-2f70-498f-ac3e-2d31db4c2fec tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:05.272599 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0ec7e81c-2f70-498f-ac3e-2d31db4c2fec tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:05.279792 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0ec7e81c-2f70-498f-ac3e-2d31db4c2fec tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.154615 Nov 23 04:25:05.280351 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 531/1122] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:05 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:06.296816 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4b611501-8ea0-4047-a421-df66171d8f53 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:06.297438 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4b611501-8ea0-4047-a421-df66171d8f53 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:06.303943 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4b611501-8ea0-4047-a421-df66171d8f53 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:06.304504 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4b611501-8ea0-4047-a421-df66171d8f53 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:06.305323 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4b611501-8ea0-4047-a421-df66171d8f53 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:06.306737 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4b611501-8ea0-4047-a421-df66171d8f53 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:06.434948 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4b611501-8ea0-4047-a421-df66171d8f53 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:06.442094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4b611501-8ea0-4047-a421-df66171d8f53 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.149174 Nov 23 04:25:06.442646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 592/1123] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:06 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:07.459445 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2d8cc420-fa2c-4686-8e65-3ac8e8c316e3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:07.460064 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2d8cc420-fa2c-4686-8e65-3ac8e8c316e3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:07.466926 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d8cc420-fa2c-4686-8e65-3ac8e8c316e3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:07.467416 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d8cc420-fa2c-4686-8e65-3ac8e8c316e3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:07.470635 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d8cc420-fa2c-4686-8e65-3ac8e8c316e3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:07.470635 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2d8cc420-fa2c-4686-8e65-3ac8e8c316e3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:07.599466 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2d8cc420-fa2c-4686-8e65-3ac8e8c316e3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:07.607722 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2d8cc420-fa2c-4686-8e65-3ac8e8c316e3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.151928 Nov 23 04:25:07.608295 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 532/1124] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:07 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:08.624445 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-47edc213-0e39-496d-98ae-c23926bfd9fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:08.625036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-47edc213-0e39-496d-98ae-c23926bfd9fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:08.631318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47edc213-0e39-496d-98ae-c23926bfd9fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:08.631762 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47edc213-0e39-496d-98ae-c23926bfd9fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:08.632535 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47edc213-0e39-496d-98ae-c23926bfd9fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:08.632962 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-47edc213-0e39-496d-98ae-c23926bfd9fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:08.766451 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-47edc213-0e39-496d-98ae-c23926bfd9fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:08.773581 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-47edc213-0e39-496d-98ae-c23926bfd9fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.152760 Nov 23 04:25:08.774126 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 593/1125] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:08 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:09.790636 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-2a04c904-10f9-45c8-9762-dd2ac28d2d16 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:09.791289 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-2a04c904-10f9-45c8-9762-dd2ac28d2d16 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:09.797255 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2a04c904-10f9-45c8-9762-dd2ac28d2d16 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:09.797711 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2a04c904-10f9-45c8-9762-dd2ac28d2d16 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:09.798498 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2a04c904-10f9-45c8-9762-dd2ac28d2d16 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:09.798940 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-2a04c904-10f9-45c8-9762-dd2ac28d2d16 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:09.926069 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-2a04c904-10f9-45c8-9762-dd2ac28d2d16 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:09.933895 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-2a04c904-10f9-45c8-9762-dd2ac28d2d16 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.146984 Nov 23 04:25:09.934403 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 533/1126] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:09 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:10.950420 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9353a3b5-df07-4515-a8f9-d1e896821a68 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:10.951035 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9353a3b5-df07-4515-a8f9-d1e896821a68 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:10.957306 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9353a3b5-df07-4515-a8f9-d1e896821a68 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:10.957749 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9353a3b5-df07-4515-a8f9-d1e896821a68 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:10.958525 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9353a3b5-df07-4515-a8f9-d1e896821a68 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:10.958960 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9353a3b5-df07-4515-a8f9-d1e896821a68 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:11.092541 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-9353a3b5-df07-4515-a8f9-d1e896821a68 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:11.099361 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9353a3b5-df07-4515-a8f9-d1e896821a68 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.153223 Nov 23 04:25:11.099943 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 594/1127] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:10 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:12.116133 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-52b70d2d-f384-4812-b3eb-bc6b8faba105 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:12.116659 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-52b70d2d-f384-4812-b3eb-bc6b8faba105 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:12.123241 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52b70d2d-f384-4812-b3eb-bc6b8faba105 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:12.130468 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52b70d2d-f384-4812-b3eb-bc6b8faba105 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:12.130468 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52b70d2d-f384-4812-b3eb-bc6b8faba105 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:12.130468 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-52b70d2d-f384-4812-b3eb-bc6b8faba105 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:12.262580 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-52b70d2d-f384-4812-b3eb-bc6b8faba105 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:12.269837 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-52b70d2d-f384-4812-b3eb-bc6b8faba105 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.157605 Nov 23 04:25:12.271974 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 534/1128] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:12 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:12.431840 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-050e5fef-78b6-422b-94de-19c097e85d50 req-9cb7207c-7a93-4358-a87a-7bb32d7fa202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d615b0-693e-47d1-932a-7dfc14f285bb", "name": "network-vif-plugged", "status": "completed", "tag": "a7c27a4c-3412-4b38-ad6e-7fd5f0d99fb9"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:12.433616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:25:12.433616 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:25:12.440820 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-050e5fef-78b6-422b-94de-19c097e85d50 req-9cb7207c-7a93-4358-a87a-7bb32d7fa202 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:12.441260 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-050e5fef-78b6-422b-94de-19c097e85d50 req-9cb7207c-7a93-4358-a87a-7bb32d7fa202 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:12.452236 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-050e5fef-78b6-422b-94de-19c097e85d50 req-9cb7207c-7a93-4358-a87a-7bb32d7fa202 service nova] Creating event network-vif-plugged:a7c27a4c-3412-4b38-ad6e-7fd5f0d99fb9 for instance 47d615b0-693e-47d1-932a-7dfc14f285bb on hv-cinder-76845 Nov 23 04:25:12.457272 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-050e5fef-78b6-422b-94de-19c097e85d50 req-9cb7207c-7a93-4358-a87a-7bb32d7fa202 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029079 Nov 23 04:25:12.457837 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 595/1129] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:25:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:25:13.287263 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0e4f12d2-f385-4948-84e2-9ffdc66e087c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:13.287902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0e4f12d2-f385-4948-84e2-9ffdc66e087c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:13.294931 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e4f12d2-f385-4948-84e2-9ffdc66e087c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:13.295407 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e4f12d2-f385-4948-84e2-9ffdc66e087c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:13.296182 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e4f12d2-f385-4948-84e2-9ffdc66e087c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:13.296614 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0e4f12d2-f385-4948-84e2-9ffdc66e087c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:13.427266 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0e4f12d2-f385-4948-84e2-9ffdc66e087c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:13.435156 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0e4f12d2-f385-4948-84e2-9ffdc66e087c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.151571 Nov 23 04:25:13.435754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 535/1130] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:13 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:14.453061 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-230e1c90-fee6-476d-9c72-428306e488b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:14.453861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-230e1c90-fee6-476d-9c72-428306e488b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:14.459879 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-230e1c90-fee6-476d-9c72-428306e488b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:14.460386 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-230e1c90-fee6-476d-9c72-428306e488b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:14.461166 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-230e1c90-fee6-476d-9c72-428306e488b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:14.461603 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-230e1c90-fee6-476d-9c72-428306e488b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:14.595715 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-230e1c90-fee6-476d-9c72-428306e488b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:14.603117 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-230e1c90-fee6-476d-9c72-428306e488b9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1549 microversion: 2.1 time: 0.155349 Nov 23 04:25:14.603697 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 596/1131] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:14 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:14.618838 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a6f05ab2-ece9-4e3a-9e7b-15ce5d7c1b88 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:14.619371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a6f05ab2-ece9-4e3a-9e7b-15ce5d7c1b88 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:14.625903 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a6f05ab2-ece9-4e3a-9e7b-15ce5d7c1b88 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:14.626348 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a6f05ab2-ece9-4e3a-9e7b-15ce5d7c1b88 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:14.627126 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a6f05ab2-ece9-4e3a-9e7b-15ce5d7c1b88 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:14.627587 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a6f05ab2-ece9-4e3a-9e7b-15ce5d7c1b88 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:14.710971 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a6f05ab2-ece9-4e3a-9e7b-15ce5d7c1b88 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095775 Nov 23 04:25:14.711671 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 536/1132] 10.222.0.54 () {58 vars in 1274 bytes} [Tue Nov 23 04:25:14 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:25:15.009094 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-327236614", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-673532001", "security_groups": [{"name": "tempest-secgroup-smoke-354329014"}], "block_device_mapping_v2": [{"uuid": "b1e38506-c522-478c-9d55-033bde9ce35c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3f5880c1-f079-4dc1-b8fc-71110c737c22"}]}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:15.149330 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] validate_networks() for [('3f5880c1-f079-4dc1-b8fc-71110c737c22', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:25:15.770588 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:25:15.771225 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:25:15.771555 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:25:15.771986 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:25:15.772398 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:25:15.782317 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:15.782757 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:15.783597 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:15.784490 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:15.799614 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Getting quotas for project 8068470657b040ab9af34219d8935846. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:25:15.803678 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Getting quotas for user 97e3605d1b0045e48d5836380ce77dc6 and project 8068470657b040ab9af34219d8935846. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:25:15.858512 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:25:15.860649 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1e38506-c522-478c-9d55-033bde9ce35c',volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:25:15.979710 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7645bf3d-443d-4920-b421-9419b6471455 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:15.980633 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7645bf3d-443d-4920-b421-9419b6471455 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:15.989240 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7645bf3d-443d-4920-b421-9419b6471455 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:15.992047 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7645bf3d-443d-4920-b421-9419b6471455 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:15.992047 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7645bf3d-443d-4920-b421-9419b6471455 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:15.992047 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7645bf3d-443d-4920-b421-9419b6471455 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:16.083051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7645bf3d-443d-4920-b421-9419b6471455 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 14 microversion: 2.1 time: 0.107357 Nov 23 04:25:16.086567 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 537/1133] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:15 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 23 04:25:16.089301 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-d539b7ce-8ad7-4ac5-8bc8-f9ea3ff853e7 req-b5578ede-4f9d-49c6-8a44-5240b492011a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d615b0-693e-47d1-932a-7dfc14f285bb", "tag": "a7c27a4c-3412-4b38-ad6e-7fd5f0d99fb9"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:16.090401 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:25:16.090401 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:25:16.098350 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-d539b7ce-8ad7-4ac5-8bc8-f9ea3ff853e7 req-b5578ede-4f9d-49c6-8a44-5240b492011a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:16.098796 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-d539b7ce-8ad7-4ac5-8bc8-f9ea3ff853e7 req-b5578ede-4f9d-49c6-8a44-5240b492011a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:16.110717 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-d539b7ce-8ad7-4ac5-8bc8-f9ea3ff853e7 req-b5578ede-4f9d-49c6-8a44-5240b492011a service nova] Creating event network-changed:a7c27a4c-3412-4b38-ad6e-7fd5f0d99fb9 for instance 47d615b0-693e-47d1-932a-7dfc14f285bb on hv-cinder-76845 Nov 23 04:25:16.116409 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-d539b7ce-8ad7-4ac5-8bc8-f9ea3ff853e7 req-b5578ede-4f9d-49c6-8a44-5240b492011a service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031223 Nov 23 04:25:16.117020 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 538/1134] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:25:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:25:16.280202 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b1c2b238-ea5f-49dc-bab3-97854f373858 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.274778 Nov 23 04:25:16.281668 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 597/1135] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:25:15 2021] POST /compute/v2.1/servers => generated 405 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:25:16.292355 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-93799abc-6013-40ad-8091-e4050c97d2dd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:16.293379 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-93799abc-6013-40ad-8091-e4050c97d2dd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:16.388709 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-93799abc-6013-40ad-8091-e4050c97d2dd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:16.404170 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-93799abc-6013-40ad-8091-e4050c97d2dd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1093 microversion: 2.1 time: 0.116228 Nov 23 04:25:16.405815 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 539/1136] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:16 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1093 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:17.094768 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2d5af94b-453b-4880-9819-1ac834f49366 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:17.095807 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2d5af94b-453b-4880-9819-1ac834f49366 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:17.101857 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d5af94b-453b-4880-9819-1ac834f49366 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:17.102308 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d5af94b-453b-4880-9819-1ac834f49366 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:17.103122 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d5af94b-453b-4880-9819-1ac834f49366 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:17.103583 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2d5af94b-453b-4880-9819-1ac834f49366 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:17.182514 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2d5af94b-453b-4880-9819-1ac834f49366 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 14 microversion: 2.1 time: 0.091877 Nov 23 04:25:17.183923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 598/1137] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:17 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:25:17.422105 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a4f03c5f-f1ff-411f-8754-fd9eb24ad6bd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:17.422695 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a4f03c5f-f1ff-411f-8754-fd9eb24ad6bd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:17.429375 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4f03c5f-f1ff-411f-8754-fd9eb24ad6bd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:17.429824 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4f03c5f-f1ff-411f-8754-fd9eb24ad6bd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:17.430591 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4f03c5f-f1ff-411f-8754-fd9eb24ad6bd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:17.431025 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a4f03c5f-f1ff-411f-8754-fd9eb24ad6bd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:17.492390 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a4f03c5f-f1ff-411f-8754-fd9eb24ad6bd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:17.499929 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a4f03c5f-f1ff-411f-8754-fd9eb24ad6bd tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1143 microversion: 2.1 time: 0.082095 Nov 23 04:25:17.500508 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 540/1138] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:17 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:18.194456 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fb83be39-79e5-4b4c-a8a6-831173e6b76d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:18.195406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fb83be39-79e5-4b4c-a8a6-831173e6b76d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:18.203098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fb83be39-79e5-4b4c-a8a6-831173e6b76d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:18.203551 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fb83be39-79e5-4b4c-a8a6-831173e6b76d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:18.212977 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fb83be39-79e5-4b4c-a8a6-831173e6b76d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:18.212977 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fb83be39-79e5-4b4c-a8a6-831173e6b76d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:18.285337 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fb83be39-79e5-4b4c-a8a6-831173e6b76d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 14 microversion: 2.1 time: 0.094831 Nov 23 04:25:18.286127 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 599/1139] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:18 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:25:18.516507 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-79a4d13b-a364-4a93-9a7f-743c49451174 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:18.517203 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-79a4d13b-a364-4a93-9a7f-743c49451174 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:18.523970 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-79a4d13b-a364-4a93-9a7f-743c49451174 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:18.524422 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-79a4d13b-a364-4a93-9a7f-743c49451174 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:18.525432 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-79a4d13b-a364-4a93-9a7f-743c49451174 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:18.525873 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-79a4d13b-a364-4a93-9a7f-743c49451174 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:18.800614 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-79a4d13b-a364-4a93-9a7f-743c49451174 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:18.809505 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-79a4d13b-a364-4a93-9a7f-743c49451174 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1209 microversion: 2.1 time: 0.296579 Nov 23 04:25:18.810450 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 541/1140] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:18 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1209 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:19.297245 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-746727de-afc1-4d18-ba24-716b77c709d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:19.298245 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-746727de-afc1-4d18-ba24-716b77c709d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:19.305599 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-746727de-afc1-4d18-ba24-716b77c709d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:19.306054 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-746727de-afc1-4d18-ba24-716b77c709d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:19.306846 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-746727de-afc1-4d18-ba24-716b77c709d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:19.307308 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-746727de-afc1-4d18-ba24-716b77c709d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:19.408638 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-746727de-afc1-4d18-ba24-716b77c709d1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 14 microversion: 2.1 time: 0.115556 Nov 23 04:25:19.409282 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 600/1141] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:19 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:25:19.828335 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-586002d0-a76e-4158-99ad-3ff15c9a9686 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:19.828961 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-586002d0-a76e-4158-99ad-3ff15c9a9686 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:19.835005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-586002d0-a76e-4158-99ad-3ff15c9a9686 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:19.835480 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-586002d0-a76e-4158-99ad-3ff15c9a9686 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:19.836332 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-586002d0-a76e-4158-99ad-3ff15c9a9686 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:19.836788 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-586002d0-a76e-4158-99ad-3ff15c9a9686 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:19.998982 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-586002d0-a76e-4158-99ad-3ff15c9a9686 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:20.006314 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-586002d0-a76e-4158-99ad-3ff15c9a9686 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1276 microversion: 2.1 time: 0.182380 Nov 23 04:25:20.006875 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 542/1142] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:19 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:20.343544 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-3aff529c-c0a0-4d1f-9902-ee0fc0711b7a req-d2d502ee-e86a-46f7-8e4a-416222c709c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9", "tag": "6cdf2244-83da-4def-a6ac-139f11920457"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:20.347119 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:25:20.347119 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:25:20.356477 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-3aff529c-c0a0-4d1f-9902-ee0fc0711b7a req-d2d502ee-e86a-46f7-8e4a-416222c709c5 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:20.361423 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-3aff529c-c0a0-4d1f-9902-ee0fc0711b7a req-d2d502ee-e86a-46f7-8e4a-416222c709c5 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:20.369487 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-3aff529c-c0a0-4d1f-9902-ee0fc0711b7a req-d2d502ee-e86a-46f7-8e4a-416222c709c5 service nova] Creating event network-changed:6cdf2244-83da-4def-a6ac-139f11920457 for instance 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 on hv-cinder-76845 Nov 23 04:25:20.374266 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-3aff529c-c0a0-4d1f-9902-ee0fc0711b7a req-d2d502ee-e86a-46f7-8e4a-416222c709c5 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035507 Nov 23 04:25:20.374861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 601/1143] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:25:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:25:20.420493 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-612ac5eb-aaca-4fdf-8716-434884b0d20e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:20.421572 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-612ac5eb-aaca-4fdf-8716-434884b0d20e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:20.427748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-612ac5eb-aaca-4fdf-8716-434884b0d20e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:20.428197 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-612ac5eb-aaca-4fdf-8716-434884b0d20e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:20.428975 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-612ac5eb-aaca-4fdf-8716-434884b0d20e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:20.429414 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-612ac5eb-aaca-4fdf-8716-434884b0d20e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:20.520858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-612ac5eb-aaca-4fdf-8716-434884b0d20e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 14 microversion: 2.1 time: 0.104683 Nov 23 04:25:20.524065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 543/1144] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:20 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:25:21.081039 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-cd21d373-d428-4e86-9d88-b785431df9f6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:21.081746 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-cd21d373-d428-4e86-9d88-b785431df9f6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:21.087765 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cd21d373-d428-4e86-9d88-b785431df9f6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:21.088228 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cd21d373-d428-4e86-9d88-b785431df9f6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:21.089055 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cd21d373-d428-4e86-9d88-b785431df9f6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:21.089917 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cd21d373-d428-4e86-9d88-b785431df9f6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:21.233921 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-cd21d373-d428-4e86-9d88-b785431df9f6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:21.241276 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-cd21d373-d428-4e86-9d88-b785431df9f6 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.221458 Nov 23 04:25:21.241836 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 602/1145] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:21 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:21.532669 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8d316617-6930-4427-9d7a-c0af2fff28f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:21.533659 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8d316617-6930-4427-9d7a-c0af2fff28f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:21.540435 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8d316617-6930-4427-9d7a-c0af2fff28f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:21.540881 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8d316617-6930-4427-9d7a-c0af2fff28f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:21.541649 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8d316617-6930-4427-9d7a-c0af2fff28f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:21.542086 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8d316617-6930-4427-9d7a-c0af2fff28f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:21.630428 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8d316617-6930-4427-9d7a-c0af2fff28f0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 14 microversion: 2.1 time: 0.101843 Nov 23 04:25:21.631065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 544/1146] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:21 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:25:22.259460 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ff8f33e8-3725-47b0-acad-4f26a401bbde tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:22.260070 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ff8f33e8-3725-47b0-acad-4f26a401bbde tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:22.266821 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ff8f33e8-3725-47b0-acad-4f26a401bbde tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:22.267778 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ff8f33e8-3725-47b0-acad-4f26a401bbde tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:22.268068 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ff8f33e8-3725-47b0-acad-4f26a401bbde tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:22.268501 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ff8f33e8-3725-47b0-acad-4f26a401bbde tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:22.401137 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ff8f33e8-3725-47b0-acad-4f26a401bbde tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:22.408610 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ff8f33e8-3725-47b0-acad-4f26a401bbde tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.152939 Nov 23 04:25:22.409213 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 603/1147] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:22 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:22.641895 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-22ad092e-34ea-44ae-8d15-210c2486ef4d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:22.642820 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-22ad092e-34ea-44ae-8d15-210c2486ef4d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:22.649643 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-22ad092e-34ea-44ae-8d15-210c2486ef4d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:22.650098 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-22ad092e-34ea-44ae-8d15-210c2486ef4d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:22.650882 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-22ad092e-34ea-44ae-8d15-210c2486ef4d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:22.651345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-22ad092e-34ea-44ae-8d15-210c2486ef4d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:22.732139 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-22ad092e-34ea-44ae-8d15-210c2486ef4d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 14 microversion: 2.1 time: 0.093665 Nov 23 04:25:22.732751 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 545/1148] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:22 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:25:23.425489 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c803a8ae-3921-44c6-bcc2-ff8bfb520af1 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:23.426046 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c803a8ae-3921-44c6-bcc2-ff8bfb520af1 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:23.432185 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c803a8ae-3921-44c6-bcc2-ff8bfb520af1 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:23.432630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c803a8ae-3921-44c6-bcc2-ff8bfb520af1 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:23.433402 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c803a8ae-3921-44c6-bcc2-ff8bfb520af1 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:23.433834 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c803a8ae-3921-44c6-bcc2-ff8bfb520af1 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:23.565095 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c803a8ae-3921-44c6-bcc2-ff8bfb520af1 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:23.572291 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c803a8ae-3921-44c6-bcc2-ff8bfb520af1 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.150568 Nov 23 04:25:23.572846 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 604/1149] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:23 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:23.743466 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a5d28bd7-6379-44ea-84a6-581bd0b94161 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:23.744499 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a5d28bd7-6379-44ea-84a6-581bd0b94161 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:23.752062 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a5d28bd7-6379-44ea-84a6-581bd0b94161 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:23.752515 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a5d28bd7-6379-44ea-84a6-581bd0b94161 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:23.753383 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a5d28bd7-6379-44ea-84a6-581bd0b94161 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:23.753822 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a5d28bd7-6379-44ea-84a6-581bd0b94161 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:23.833282 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a5d28bd7-6379-44ea-84a6-581bd0b94161 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 14 microversion: 2.1 time: 0.093846 Nov 23 04:25:23.833968 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 546/1150] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:23 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:25:24.589644 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-af90ebb8-34ca-4450-9f0c-881500c278c0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:24.590283 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-af90ebb8-34ca-4450-9f0c-881500c278c0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:24.597263 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-af90ebb8-34ca-4450-9f0c-881500c278c0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:24.597709 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-af90ebb8-34ca-4450-9f0c-881500c278c0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:24.598490 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-af90ebb8-34ca-4450-9f0c-881500c278c0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:24.598923 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-af90ebb8-34ca-4450-9f0c-881500c278c0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:24.733687 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-af90ebb8-34ca-4450-9f0c-881500c278c0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:24.740813 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-af90ebb8-34ca-4450-9f0c-881500c278c0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.154808 Nov 23 04:25:24.741360 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 605/1151] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:24 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:24.844900 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4ba459f7-96cc-40a3-8b7d-551d7132046b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:24.845816 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4ba459f7-96cc-40a3-8b7d-551d7132046b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:24.852630 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ba459f7-96cc-40a3-8b7d-551d7132046b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:24.853087 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ba459f7-96cc-40a3-8b7d-551d7132046b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:24.853871 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ba459f7-96cc-40a3-8b7d-551d7132046b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:24.854314 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4ba459f7-96cc-40a3-8b7d-551d7132046b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:24.950810 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4ba459f7-96cc-40a3-8b7d-551d7132046b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 14 microversion: 2.1 time: 0.110229 Nov 23 04:25:24.952163 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 547/1152] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:24 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:25:25.758066 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0a804937-43a5-440f-80e3-fd21f2afe697 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:25.758670 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0a804937-43a5-440f-80e3-fd21f2afe697 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:25.765158 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0a804937-43a5-440f-80e3-fd21f2afe697 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:25.765597 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0a804937-43a5-440f-80e3-fd21f2afe697 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:25.766369 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0a804937-43a5-440f-80e3-fd21f2afe697 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:25.766794 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0a804937-43a5-440f-80e3-fd21f2afe697 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:25.896712 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-0a804937-43a5-440f-80e3-fd21f2afe697 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:25.904127 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0a804937-43a5-440f-80e3-fd21f2afe697 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.149641 Nov 23 04:25:25.906074 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 606/1153] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:25 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:25.962913 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-20fa434e-e00a-4cb4-a9cc-f18503a10fe8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:25.966617 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-20fa434e-e00a-4cb4-a9cc-f18503a10fe8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:25.971467 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20fa434e-e00a-4cb4-a9cc-f18503a10fe8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:25.971930 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20fa434e-e00a-4cb4-a9cc-f18503a10fe8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:25.972708 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20fa434e-e00a-4cb4-a9cc-f18503a10fe8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:25.973147 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-20fa434e-e00a-4cb4-a9cc-f18503a10fe8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:26.053413 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-20fa434e-e00a-4cb4-a9cc-f18503a10fe8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 14 microversion: 2.1 time: 0.094453 Nov 23 04:25:26.054076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 548/1154] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:25 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:25:26.922302 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5554374b-e259-4837-b5ee-9ef1f2fca99d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:26.922901 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5554374b-e259-4837-b5ee-9ef1f2fca99d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:26.929121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5554374b-e259-4837-b5ee-9ef1f2fca99d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:26.929618 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5554374b-e259-4837-b5ee-9ef1f2fca99d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:26.930328 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5554374b-e259-4837-b5ee-9ef1f2fca99d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:26.930757 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5554374b-e259-4837-b5ee-9ef1f2fca99d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:27.064791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a09688dc-b57b-45d1-ad80-b500f769e999 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:27.065789 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a09688dc-b57b-45d1-ad80-b500f769e999 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:27.069180 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-5554374b-e259-4837-b5ee-9ef1f2fca99d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:27.072916 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a09688dc-b57b-45d1-ad80-b500f769e999 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:27.073451 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a09688dc-b57b-45d1-ad80-b500f769e999 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:27.074244 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a09688dc-b57b-45d1-ad80-b500f769e999 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:27.074685 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a09688dc-b57b-45d1-ad80-b500f769e999 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:27.076312 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5554374b-e259-4837-b5ee-9ef1f2fca99d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.158177 Nov 23 04:25:27.077230 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 607/1155] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:26 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:27.163815 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a09688dc-b57b-45d1-ad80-b500f769e999 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 4298 microversion: 2.1 time: 0.102885 Nov 23 04:25:27.164954 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 549/1156] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:27 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 4298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:25:28.094191 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-25a3f976-0e75-4d77-9212-2165aa041586 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:28.094798 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-25a3f976-0e75-4d77-9212-2165aa041586 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:28.101163 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-25a3f976-0e75-4d77-9212-2165aa041586 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:28.101610 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-25a3f976-0e75-4d77-9212-2165aa041586 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:28.102385 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-25a3f976-0e75-4d77-9212-2165aa041586 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:28.102820 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-25a3f976-0e75-4d77-9212-2165aa041586 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:28.175349 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a6a2790d-e8a2-4a30-a09b-bea7f070c61c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:28.176349 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a6a2790d-e8a2-4a30-a09b-bea7f070c61c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:28.183352 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a6a2790d-e8a2-4a30-a09b-bea7f070c61c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:28.183814 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a6a2790d-e8a2-4a30-a09b-bea7f070c61c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:28.184603 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a6a2790d-e8a2-4a30-a09b-bea7f070c61c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:28.185031 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a6a2790d-e8a2-4a30-a09b-bea7f070c61c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:28.237202 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-25a3f976-0e75-4d77-9212-2165aa041586 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:28.244543 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-25a3f976-0e75-4d77-9212-2165aa041586 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.154706 Nov 23 04:25:28.245111 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 608/1157] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:28 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:28.296753 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a6a2790d-e8a2-4a30-a09b-bea7f070c61c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 15025 microversion: 2.1 time: 0.125471 Nov 23 04:25:28.297410 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 550/1158] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:28 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 15025 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:25:29.261311 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4d2a0fc3-753e-4ec1-86d7-8d00e4ae1057 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:29.261942 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4d2a0fc3-753e-4ec1-86d7-8d00e4ae1057 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:29.268946 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d2a0fc3-753e-4ec1-86d7-8d00e4ae1057 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:29.269333 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d2a0fc3-753e-4ec1-86d7-8d00e4ae1057 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:29.270097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d2a0fc3-753e-4ec1-86d7-8d00e4ae1057 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:29.270525 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d2a0fc3-753e-4ec1-86d7-8d00e4ae1057 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:29.308326 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8429a366-c2e2-480b-984c-00839cafb6eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:29.309332 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8429a366-c2e2-480b-984c-00839cafb6eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:29.317369 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8429a366-c2e2-480b-984c-00839cafb6eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:29.317824 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8429a366-c2e2-480b-984c-00839cafb6eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:29.318622 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8429a366-c2e2-480b-984c-00839cafb6eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:29.319068 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8429a366-c2e2-480b-984c-00839cafb6eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:29.406415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4d2a0fc3-753e-4ec1-86d7-8d00e4ae1057 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:29.413732 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4d2a0fc3-753e-4ec1-86d7-8d00e4ae1057 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.156002 Nov 23 04:25:29.413987 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8429a366-c2e2-480b-984c-00839cafb6eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 18356 microversion: 2.1 time: 0.109446 Nov 23 04:25:29.414297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 609/1159] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:29 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:29.414809 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 551/1160] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:29 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 18356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:25:30.425064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-99ab6ce3-58e2-4adc-963d-1962cb659e4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:30.425974 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-99ab6ce3-58e2-4adc-963d-1962cb659e4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:30.430215 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a8e15553-506f-44a8-98e2-c0f0a8ac1912 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:30.431821 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a8e15553-506f-44a8-98e2-c0f0a8ac1912 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:30.432289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-99ab6ce3-58e2-4adc-963d-1962cb659e4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:30.432737 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-99ab6ce3-58e2-4adc-963d-1962cb659e4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:30.433515 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-99ab6ce3-58e2-4adc-963d-1962cb659e4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:30.433943 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-99ab6ce3-58e2-4adc-963d-1962cb659e4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:30.437892 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a8e15553-506f-44a8-98e2-c0f0a8ac1912 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:30.438384 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a8e15553-506f-44a8-98e2-c0f0a8ac1912 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:30.439174 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a8e15553-506f-44a8-98e2-c0f0a8ac1912 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:30.439667 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a8e15553-506f-44a8-98e2-c0f0a8ac1912 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:30.532997 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-99ab6ce3-58e2-4adc-963d-1962cb659e4f tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 19342 microversion: 2.1 time: 0.111347 Nov 23 04:25:30.536808 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 610/1161] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:30 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 19342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:30.574821 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a8e15553-506f-44a8-98e2-c0f0a8ac1912 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:30.582621 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a8e15553-506f-44a8-98e2-c0f0a8ac1912 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.156614 Nov 23 04:25:30.583185 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 552/1162] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:30 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:25:31.545025 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8c0ff17d-ca2e-4baf-8814-83b04755cb9a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:31.546603 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8c0ff17d-ca2e-4baf-8814-83b04755cb9a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:31.553415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8c0ff17d-ca2e-4baf-8814-83b04755cb9a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:31.553868 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8c0ff17d-ca2e-4baf-8814-83b04755cb9a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:31.554646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8c0ff17d-ca2e-4baf-8814-83b04755cb9a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:31.555083 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8c0ff17d-ca2e-4baf-8814-83b04755cb9a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:31.599138 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-ccd347ee-6bb8-4173-bf0d-9e4d9792baa0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:31.599774 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-ccd347ee-6bb8-4173-bf0d-9e4d9792baa0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:31.606005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ccd347ee-6bb8-4173-bf0d-9e4d9792baa0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:31.606450 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ccd347ee-6bb8-4173-bf0d-9e4d9792baa0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:31.607239 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ccd347ee-6bb8-4173-bf0d-9e4d9792baa0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:31.607764 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-ccd347ee-6bb8-4173-bf0d-9e4d9792baa0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:31.647702 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8c0ff17d-ca2e-4baf-8814-83b04755cb9a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 21935 microversion: 2.1 time: 0.106534 Nov 23 04:25:31.651332 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 611/1163] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:31 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 21935 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:31.739533 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-ccd347ee-6bb8-4173-bf0d-9e4d9792baa0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:31.747092 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-ccd347ee-6bb8-4173-bf0d-9e4d9792baa0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.151529 Nov 23 04:25:31.747809 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 553/1164] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:31 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:25:32.644328 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-00e526ac-27e4-4789-ab60-c40ad69b0d8a req-dfcdf880-5830-43f9-8823-0e50503889ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9", "name": "network-vif-plugged", "status": "completed", "tag": "6cdf2244-83da-4def-a6ac-139f11920457"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:32.645814 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:25:32.645814 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:25:32.653353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-00e526ac-27e4-4789-ab60-c40ad69b0d8a req-dfcdf880-5830-43f9-8823-0e50503889ee service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:32.654000 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-00e526ac-27e4-4789-ab60-c40ad69b0d8a req-dfcdf880-5830-43f9-8823-0e50503889ee service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:32.659898 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-836994f3-c138-4e2e-ab5b-323011994113 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:32.660839 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-836994f3-c138-4e2e-ab5b-323011994113 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:32.667642 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-00e526ac-27e4-4789-ab60-c40ad69b0d8a req-dfcdf880-5830-43f9-8823-0e50503889ee service nova] Creating event network-vif-plugged:6cdf2244-83da-4def-a6ac-139f11920457 for instance 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 on hv-cinder-76845 Nov 23 04:25:32.667858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-836994f3-c138-4e2e-ab5b-323011994113 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:32.667858 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-836994f3-c138-4e2e-ab5b-323011994113 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:32.668450 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-836994f3-c138-4e2e-ab5b-323011994113 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:32.668905 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-836994f3-c138-4e2e-ab5b-323011994113 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:32.672329 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-00e526ac-27e4-4789-ab60-c40ad69b0d8a req-dfcdf880-5830-43f9-8823-0e50503889ee service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085675 Nov 23 04:25:32.673219 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 612/1165] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:25:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:25:32.762235 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-836994f3-c138-4e2e-ab5b-323011994113 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 23234 microversion: 2.1 time: 0.106034 Nov 23 04:25:32.763075 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 554/1166] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:32 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 23234 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:25:32.764863 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-df0fb239-069c-4dee-b7a4-79a52e175b10 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:32.765679 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-df0fb239-069c-4dee-b7a4-79a52e175b10 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:32.771897 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-df0fb239-069c-4dee-b7a4-79a52e175b10 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:32.772348 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-df0fb239-069c-4dee-b7a4-79a52e175b10 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:32.773163 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-df0fb239-069c-4dee-b7a4-79a52e175b10 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:32.773602 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-df0fb239-069c-4dee-b7a4-79a52e175b10 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:32.910922 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-df0fb239-069c-4dee-b7a4-79a52e175b10 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:32.918477 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-df0fb239-069c-4dee-b7a4-79a52e175b10 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.158839 Nov 23 04:25:32.919433 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 613/1167] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:32 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:25:33.774669 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f65fde43-20da-443d-87c6-6ee0dc0580b2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:33.775694 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f65fde43-20da-443d-87c6-6ee0dc0580b2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:33.782901 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f65fde43-20da-443d-87c6-6ee0dc0580b2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:33.783398 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f65fde43-20da-443d-87c6-6ee0dc0580b2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:33.784179 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f65fde43-20da-443d-87c6-6ee0dc0580b2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:33.784623 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f65fde43-20da-443d-87c6-6ee0dc0580b2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:33.885240 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f65fde43-20da-443d-87c6-6ee0dc0580b2 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 24779 microversion: 2.1 time: 0.114503 Nov 23 04:25:33.885862 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 555/1168] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:33 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 24779 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:33.937118 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fb5ff553-694d-4d3b-89d3-5397db573ea3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:33.937667 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fb5ff553-694d-4d3b-89d3-5397db573ea3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:33.943898 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fb5ff553-694d-4d3b-89d3-5397db573ea3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:33.944411 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fb5ff553-694d-4d3b-89d3-5397db573ea3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:33.945193 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fb5ff553-694d-4d3b-89d3-5397db573ea3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:33.945629 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fb5ff553-694d-4d3b-89d3-5397db573ea3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:34.077968 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-fb5ff553-694d-4d3b-89d3-5397db573ea3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:34.086233 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fb5ff553-694d-4d3b-89d3-5397db573ea3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1264 microversion: 2.1 time: 0.153619 Nov 23 04:25:34.086787 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 614/1169] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:33 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:34.897561 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-92cdaa82-de96-413d-a558-7adc62c1f889 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:34.898628 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-92cdaa82-de96-413d-a558-7adc62c1f889 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:34.905676 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-92cdaa82-de96-413d-a558-7adc62c1f889 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:34.906129 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-92cdaa82-de96-413d-a558-7adc62c1f889 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:34.906902 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-92cdaa82-de96-413d-a558-7adc62c1f889 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:34.907381 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-92cdaa82-de96-413d-a558-7adc62c1f889 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:35.007369 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-92cdaa82-de96-413d-a558-7adc62c1f889 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 26053 microversion: 2.1 time: 0.113641 Nov 23 04:25:35.008017 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 556/1170] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:34 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 26053 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:35.102868 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b2bcb309-7265-49ac-82b3-9574cec28b60 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:35.103513 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b2bcb309-7265-49ac-82b3-9574cec28b60 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:35.110353 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b2bcb309-7265-49ac-82b3-9574cec28b60 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:35.110804 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b2bcb309-7265-49ac-82b3-9574cec28b60 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:35.111622 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b2bcb309-7265-49ac-82b3-9574cec28b60 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:35.112057 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b2bcb309-7265-49ac-82b3-9574cec28b60 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:35.241428 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b2bcb309-7265-49ac-82b3-9574cec28b60 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:35.249315 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b2bcb309-7265-49ac-82b3-9574cec28b60 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1452 microversion: 2.1 time: 0.150057 Nov 23 04:25:35.249883 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 615/1171] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:35 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:35.265852 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-082aff30-e14a-48b7-8fda-1d3622350cf7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:35.266624 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-082aff30-e14a-48b7-8fda-1d3622350cf7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:35.273438 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-082aff30-e14a-48b7-8fda-1d3622350cf7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:35.273883 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-082aff30-e14a-48b7-8fda-1d3622350cf7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:35.274651 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-082aff30-e14a-48b7-8fda-1d3622350cf7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:35.275079 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-082aff30-e14a-48b7-8fda-1d3622350cf7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:35.412220 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-082aff30-e14a-48b7-8fda-1d3622350cf7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:25:35.419446 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-082aff30-e14a-48b7-8fda-1d3622350cf7 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1452 microversion: 2.1 time: 0.157702 Nov 23 04:25:35.420116 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 557/1172] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:25:35 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:25:36.019277 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1472d6d9-ea08-4131-b09a-cf81c33ca4f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:36.020241 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1472d6d9-ea08-4131-b09a-cf81c33ca4f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:36.025948 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1472d6d9-ea08-4131-b09a-cf81c33ca4f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:36.026393 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1472d6d9-ea08-4131-b09a-cf81c33ca4f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:36.027166 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1472d6d9-ea08-4131-b09a-cf81c33ca4f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:36.027608 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1472d6d9-ea08-4131-b09a-cf81c33ca4f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:36.125846 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1472d6d9-ea08-4131-b09a-cf81c33ca4f1 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 27244 microversion: 2.1 time: 0.110052 Nov 23 04:25:36.126489 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 616/1173] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:36 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 27244 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:37.137609 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fd95f3ee-6331-4061-a636-789d4a2e2122 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:37.139190 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fd95f3ee-6331-4061-a636-789d4a2e2122 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:37.145522 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd95f3ee-6331-4061-a636-789d4a2e2122 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:37.145976 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd95f3ee-6331-4061-a636-789d4a2e2122 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:37.146758 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd95f3ee-6331-4061-a636-789d4a2e2122 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:37.147261 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fd95f3ee-6331-4061-a636-789d4a2e2122 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:37.239095 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fd95f3ee-6331-4061-a636-789d4a2e2122 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 27741 microversion: 2.1 time: 0.104960 Nov 23 04:25:37.239795 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 558/1174] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:37 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 27741 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:37.333196 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-c2f1841d-8959-4f09-8750-dc8d2049f68b req-06ac51dc-45ef-453b-b768-8217ed3c527c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9", "tag": "6cdf2244-83da-4def-a6ac-139f11920457"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:37.334694 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:25:37.334694 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:25:37.343119 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-c2f1841d-8959-4f09-8750-dc8d2049f68b req-06ac51dc-45ef-453b-b768-8217ed3c527c service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:37.343590 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-c2f1841d-8959-4f09-8750-dc8d2049f68b req-06ac51dc-45ef-453b-b768-8217ed3c527c service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:37.354804 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-c2f1841d-8959-4f09-8750-dc8d2049f68b req-06ac51dc-45ef-453b-b768-8217ed3c527c service nova] Creating event network-changed:6cdf2244-83da-4def-a6ac-139f11920457 for instance 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 on hv-cinder-76845 Nov 23 04:25:37.359573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-c2f1841d-8959-4f09-8750-dc8d2049f68b req-06ac51dc-45ef-453b-b768-8217ed3c527c service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030618 Nov 23 04:25:37.360148 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 617/1175] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:25:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:25:38.252429 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d9a8df49-f6e0-4b65-9482-8eb81a715d08 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:38.253469 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d9a8df49-f6e0-4b65-9482-8eb81a715d08 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:38.260408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9a8df49-f6e0-4b65-9482-8eb81a715d08 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:38.261117 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9a8df49-f6e0-4b65-9482-8eb81a715d08 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:38.266766 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9a8df49-f6e0-4b65-9482-8eb81a715d08 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:38.266766 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d9a8df49-f6e0-4b65-9482-8eb81a715d08 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:38.356440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d9a8df49-f6e0-4b65-9482-8eb81a715d08 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 28220 microversion: 2.1 time: 0.108189 Nov 23 04:25:38.357016 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 559/1176] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:38 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 28220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:39.370072 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-931c0e9d-bad2-45c2-8ad1-c165ce10e67d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:39.371070 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-931c0e9d-bad2-45c2-8ad1-c165ce10e67d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:39.377381 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-931c0e9d-bad2-45c2-8ad1-c165ce10e67d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:39.377825 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-931c0e9d-bad2-45c2-8ad1-c165ce10e67d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:39.378591 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-931c0e9d-bad2-45c2-8ad1-c165ce10e67d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:39.379018 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-931c0e9d-bad2-45c2-8ad1-c165ce10e67d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:39.468499 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-931c0e9d-bad2-45c2-8ad1-c165ce10e67d tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 28220 microversion: 2.1 time: 0.102686 Nov 23 04:25:39.469038 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 618/1177] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:39 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 28220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:40.481087 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-1319fb37-78c6-4f9a-9926-3c4926a4ebbe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:40.482015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-1319fb37-78c6-4f9a-9926-3c4926a4ebbe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:40.488953 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1319fb37-78c6-4f9a-9926-3c4926a4ebbe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:40.489406 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1319fb37-78c6-4f9a-9926-3c4926a4ebbe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:40.490182 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1319fb37-78c6-4f9a-9926-3c4926a4ebbe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:40.490621 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-1319fb37-78c6-4f9a-9926-3c4926a4ebbe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:40.586980 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-1319fb37-78c6-4f9a-9926-3c4926a4ebbe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 28511 microversion: 2.1 time: 0.109919 Nov 23 04:25:40.587657 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 560/1178] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:40 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 28511 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:41.599489 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4775d413-d87a-47bf-8945-4275754242fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:41.600515 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4775d413-d87a-47bf-8945-4275754242fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:41.607316 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4775d413-d87a-47bf-8945-4275754242fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:41.607769 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4775d413-d87a-47bf-8945-4275754242fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:41.608547 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4775d413-d87a-47bf-8945-4275754242fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:41.608984 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4775d413-d87a-47bf-8945-4275754242fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:41.706412 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4775d413-d87a-47bf-8945-4275754242fb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 28679 microversion: 2.1 time: 0.110862 Nov 23 04:25:41.707047 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 619/1179] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:41 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 28679 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 23 04:25:42.718931 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5e6ea35b-cf56-431e-9167-802a407c284c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:42.719959 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-5e6ea35b-cf56-431e-9167-802a407c284c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:42.726752 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5e6ea35b-cf56-431e-9167-802a407c284c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:42.727200 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5e6ea35b-cf56-431e-9167-802a407c284c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:42.727997 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5e6ea35b-cf56-431e-9167-802a407c284c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:42.728432 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-5e6ea35b-cf56-431e-9167-802a407c284c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:42.816303 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5e6ea35b-cf56-431e-9167-802a407c284c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 28679 microversion: 2.1 time: 0.101804 Nov 23 04:25:42.817259 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 561/1180] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:42 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 28679 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:43.829298 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-8a664334-4980-406f-919c-3d0fc6fd3293 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:43.830296 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-8a664334-4980-406f-919c-3d0fc6fd3293 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:43.837221 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a664334-4980-406f-919c-3d0fc6fd3293 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:43.837675 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a664334-4980-406f-919c-3d0fc6fd3293 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:43.838454 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a664334-4980-406f-919c-3d0fc6fd3293 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:43.838893 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-8a664334-4980-406f-919c-3d0fc6fd3293 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:43.927686 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-8a664334-4980-406f-919c-3d0fc6fd3293 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 28679 microversion: 2.1 time: 0.103225 Nov 23 04:25:43.928319 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 620/1181] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:43 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 28679 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:44.940459 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-dcfbb8fb-3fe6-4629-9711-4ca8a0492bfe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:44.941473 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-dcfbb8fb-3fe6-4629-9711-4ca8a0492bfe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:44.948368 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dcfbb8fb-3fe6-4629-9711-4ca8a0492bfe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:44.948822 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dcfbb8fb-3fe6-4629-9711-4ca8a0492bfe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:44.949601 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dcfbb8fb-3fe6-4629-9711-4ca8a0492bfe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:44.950040 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-dcfbb8fb-3fe6-4629-9711-4ca8a0492bfe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:45.044091 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-dcfbb8fb-3fe6-4629-9711-4ca8a0492bfe tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 29457 microversion: 2.1 time: 0.108420 Nov 23 04:25:45.045336 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 562/1182] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:44 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 29457 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:46.056748 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-23d813ce-0504-4f86-9eb0-322ca4eebcd6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:46.057777 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-23d813ce-0504-4f86-9eb0-322ca4eebcd6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:46.064581 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-23d813ce-0504-4f86-9eb0-322ca4eebcd6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:46.065027 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-23d813ce-0504-4f86-9eb0-322ca4eebcd6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:46.065805 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-23d813ce-0504-4f86-9eb0-322ca4eebcd6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:46.066246 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-23d813ce-0504-4f86-9eb0-322ca4eebcd6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:46.167423 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-23d813ce-0504-4f86-9eb0-322ca4eebcd6 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 31347 microversion: 2.1 time: 0.114604 Nov 23 04:25:46.168080 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 621/1183] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:46 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 31347 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:47.180120 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4d6bed63-dc8f-49d8-9c02-70dcc4df753c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:47.181189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4d6bed63-dc8f-49d8-9c02-70dcc4df753c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:47.188782 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d6bed63-dc8f-49d8-9c02-70dcc4df753c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:47.189230 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d6bed63-dc8f-49d8-9c02-70dcc4df753c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:47.190008 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d6bed63-dc8f-49d8-9c02-70dcc4df753c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:47.190444 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4d6bed63-dc8f-49d8-9c02-70dcc4df753c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:47.286710 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4d6bed63-dc8f-49d8-9c02-70dcc4df753c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 32720 microversion: 2.1 time: 0.110453 Nov 23 04:25:47.287400 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 563/1184] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:47 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 32720 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:48.299017 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1c93f057-7264-4a25-93b0-d9bdc486d2eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:48.300041 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1c93f057-7264-4a25-93b0-d9bdc486d2eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:48.306914 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1c93f057-7264-4a25-93b0-d9bdc486d2eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:48.307411 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1c93f057-7264-4a25-93b0-d9bdc486d2eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:48.308199 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1c93f057-7264-4a25-93b0-d9bdc486d2eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:48.308635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1c93f057-7264-4a25-93b0-d9bdc486d2eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:48.404524 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1c93f057-7264-4a25-93b0-d9bdc486d2eb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 33606 microversion: 2.1 time: 0.109437 Nov 23 04:25:48.405450 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 622/1185] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:48 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 33606 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:49.416946 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4fd7ce64-4216-4d21-b6aa-461465da4339 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:49.417935 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4fd7ce64-4216-4d21-b6aa-461465da4339 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:49.425622 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4fd7ce64-4216-4d21-b6aa-461465da4339 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:49.426098 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4fd7ce64-4216-4d21-b6aa-461465da4339 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:49.426871 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4fd7ce64-4216-4d21-b6aa-461465da4339 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:49.427345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4fd7ce64-4216-4d21-b6aa-461465da4339 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:49.517939 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4fd7ce64-4216-4d21-b6aa-461465da4339 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 34759 microversion: 2.1 time: 0.104867 Nov 23 04:25:49.518846 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 564/1186] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:49 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 34759 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:50.530389 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-5361e7a4-f9e2-4028-8d7b-cecd7fc4e24a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:50.531414 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-5361e7a4-f9e2-4028-8d7b-cecd7fc4e24a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:50.538243 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5361e7a4-f9e2-4028-8d7b-cecd7fc4e24a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:50.538691 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5361e7a4-f9e2-4028-8d7b-cecd7fc4e24a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:50.539510 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5361e7a4-f9e2-4028-8d7b-cecd7fc4e24a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:50.539955 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-5361e7a4-f9e2-4028-8d7b-cecd7fc4e24a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:50.636560 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-5361e7a4-f9e2-4028-8d7b-cecd7fc4e24a tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 36001 microversion: 2.1 time: 0.110301 Nov 23 04:25:50.637198 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 623/1187] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:50 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 36001 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:51.648856 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-604b1b58-532e-4d1e-81be-1d2bec7258e7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:51.649845 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-604b1b58-532e-4d1e-81be-1d2bec7258e7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:51.657688 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-604b1b58-532e-4d1e-81be-1d2bec7258e7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:51.658135 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-604b1b58-532e-4d1e-81be-1d2bec7258e7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:51.658899 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-604b1b58-532e-4d1e-81be-1d2bec7258e7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:51.659372 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-604b1b58-532e-4d1e-81be-1d2bec7258e7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:51.761159 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-604b1b58-532e-4d1e-81be-1d2bec7258e7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 37427 microversion: 2.1 time: 0.116152 Nov 23 04:25:51.761838 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 565/1188] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:51 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 37427 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:52.773385 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e85ac5b6-3c4a-46a1-abf3-5a96f15c5856 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:52.774369 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e85ac5b6-3c4a-46a1-abf3-5a96f15c5856 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:52.781941 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e85ac5b6-3c4a-46a1-abf3-5a96f15c5856 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:52.782384 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e85ac5b6-3c4a-46a1-abf3-5a96f15c5856 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:52.783153 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e85ac5b6-3c4a-46a1-abf3-5a96f15c5856 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:52.783613 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e85ac5b6-3c4a-46a1-abf3-5a96f15c5856 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:52.878993 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e85ac5b6-3c4a-46a1-abf3-5a96f15c5856 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 38208 microversion: 2.1 time: 0.109509 Nov 23 04:25:52.879640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 624/1189] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:52 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 38208 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:53.891904 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-715fbaaf-bce6-4ce7-90b8-327c20022ad3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:53.892896 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-715fbaaf-bce6-4ce7-90b8-327c20022ad3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:53.899742 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-715fbaaf-bce6-4ce7-90b8-327c20022ad3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:53.900195 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-715fbaaf-bce6-4ce7-90b8-327c20022ad3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:53.900971 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-715fbaaf-bce6-4ce7-90b8-327c20022ad3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:53.901408 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-715fbaaf-bce6-4ce7-90b8-327c20022ad3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:53.988933 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-715fbaaf-bce6-4ce7-90b8-327c20022ad3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 38208 microversion: 2.1 time: 0.101570 Nov 23 04:25:53.989566 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 566/1190] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:53 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 38208 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:55.001128 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2f84e73e-01c1-4c11-8fca-6c6bb136ed7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:55.002115 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2f84e73e-01c1-4c11-8fca-6c6bb136ed7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:55.008988 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f84e73e-01c1-4c11-8fca-6c6bb136ed7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:55.009434 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f84e73e-01c1-4c11-8fca-6c6bb136ed7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:55.010202 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f84e73e-01c1-4c11-8fca-6c6bb136ed7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:55.010632 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2f84e73e-01c1-4c11-8fca-6c6bb136ed7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:55.097338 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2f84e73e-01c1-4c11-8fca-6c6bb136ed7b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 38208 microversion: 2.1 time: 0.099999 Nov 23 04:25:55.098012 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 625/1191] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:54 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 38208 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:56.110082 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-35a1fdfb-eafe-4e8e-a7b6-5b239770e9b8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:56.111085 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-35a1fdfb-eafe-4e8e-a7b6-5b239770e9b8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:56.117931 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-35a1fdfb-eafe-4e8e-a7b6-5b239770e9b8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:56.118406 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-35a1fdfb-eafe-4e8e-a7b6-5b239770e9b8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:56.119181 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-35a1fdfb-eafe-4e8e-a7b6-5b239770e9b8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:56.119654 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-35a1fdfb-eafe-4e8e-a7b6-5b239770e9b8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:56.208944 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-35a1fdfb-eafe-4e8e-a7b6-5b239770e9b8 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action" status: 200 len: 38337 microversion: 2.1 time: 0.103339 Nov 23 04:25:56.209571 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 567/1192] 10.222.0.54 () {60 vars in 1277 bytes} [Tue Nov 23 04:25:56 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/action => generated 38337 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 23 04:25:56.219781 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-6e1a308b-bac1-4e60-a282-a50960a042cb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:25:56.220377 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-6e1a308b-bac1-4e60-a282-a50960a042cb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:56.227932 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e1a308b-bac1-4e60-a282-a50960a042cb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:56.228379 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e1a308b-bac1-4e60-a282-a50960a042cb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:56.229159 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e1a308b-bac1-4e60-a282-a50960a042cb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:56.229592 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-6e1a308b-bac1-4e60-a282-a50960a042cb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:56.252685 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-6e1a308b-bac1-4e60-a282-a50960a042cb tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/ips" status: 200 len: 145 microversion: 2.1 time: 0.036984 Nov 23 04:25:56.253259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 626/1193] 10.222.0.54 () {58 vars in 1247 bytes} [Tue Nov 23 04:25:56 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:25:57.841561 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9a356ac2-9573-4dc2-b653-c38337e7726e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f656edcc-a6c7-4f4d-9241-77623853344f"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:25:57.843379 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9a356ac2-9573-4dc2-b653-c38337e7726e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:25:57.850199 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9a356ac2-9573-4dc2-b653-c38337e7726e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:57.850655 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9a356ac2-9573-4dc2-b653-c38337e7726e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:57.851458 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9a356ac2-9573-4dc2-b653-c38337e7726e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:25:57.851899 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9a356ac2-9573-4dc2-b653-c38337e7726e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:25:58.551507 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9a356ac2-9573-4dc2-b653-c38337e7726e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713861 Nov 23 04:25:58.552133 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 568/1194] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:25:57 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:00.994792 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:26:01.007799 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: Tue Nov 23 04:26:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 04:26:06.007506 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e8d621f5-bc07-4e08-9b90-b9c10d416c0b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:06.008467 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e8d621f5-bc07-4e08-9b90-b9c10d416c0b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:06.014745 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8d621f5-bc07-4e08-9b90-b9c10d416c0b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:06.015203 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8d621f5-bc07-4e08-9b90-b9c10d416c0b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:06.016024 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8d621f5-bc07-4e08-9b90-b9c10d416c0b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:06.017020 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e8d621f5-bc07-4e08-9b90-b9c10d416c0b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:06.047573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e8d621f5-bc07-4e08-9b90-b9c10d416c0b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Nov 23 04:26:06.048284 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 627/1195] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:26:06 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:06.061715 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-cd8dd79a-c4c3-486c-9eae-050eccf8791e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:06.062314 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-cd8dd79a-c4c3-486c-9eae-050eccf8791e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:06.068293 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cd8dd79a-c4c3-486c-9eae-050eccf8791e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:06.068738 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cd8dd79a-c4c3-486c-9eae-050eccf8791e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:06.069508 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cd8dd79a-c4c3-486c-9eae-050eccf8791e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:06.069945 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cd8dd79a-c4c3-486c-9eae-050eccf8791e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:06.098859 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-cd8dd79a-c4c3-486c-9eae-050eccf8791e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments/f656edcc-a6c7-4f4d-9241-77623853344f" status: 200 len: 194 microversion: 2.1 time: 0.044520 Nov 23 04:26:06.099481 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 569/1196] 10.222.0.54 () {58 vars in 1412 bytes} [Tue Nov 23 04:26:06 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments/f656edcc-a6c7-4f4d-9241-77623853344f => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:07.630260 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d791a1df-72ef-45d5-ad03-419418a1da24 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "575fbddf-994c-4fa8-bca0-7dcac28e27c0"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:26:07.631332 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d791a1df-72ef-45d5-ad03-419418a1da24 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:07.637521 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d791a1df-72ef-45d5-ad03-419418a1da24 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:07.638168 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d791a1df-72ef-45d5-ad03-419418a1da24 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:07.638943 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d791a1df-72ef-45d5-ad03-419418a1da24 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:07.639488 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d791a1df-72ef-45d5-ad03-419418a1da24 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:08.362682 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d791a1df-72ef-45d5-ad03-419418a1da24 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735852 Nov 23 04:26:08.363317 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 628/1197] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:26:07 2021] POST /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:15.821935 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4b382105-9650-4858-a81f-634773b889f9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:15.822846 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-4b382105-9650-4858-a81f-634773b889f9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:15.829220 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4b382105-9650-4858-a81f-634773b889f9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:15.830942 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4b382105-9650-4858-a81f-634773b889f9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:15.831259 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4b382105-9650-4858-a81f-634773b889f9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:15.831702 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-4b382105-9650-4858-a81f-634773b889f9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:15.863002 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4b382105-9650-4858-a81f-634773b889f9 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044863 Nov 23 04:26:15.863587 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 570/1198] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:26:15 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:16.276681 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-7a5abc1a-6c8b-4be9-8cc2-e9c625fade9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:16.277259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-7a5abc1a-6c8b-4be9-8cc2-e9c625fade9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:16.283777 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7a5abc1a-6c8b-4be9-8cc2-e9c625fade9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:16.284227 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7a5abc1a-6c8b-4be9-8cc2-e9c625fade9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:16.285009 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7a5abc1a-6c8b-4be9-8cc2-e9c625fade9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:16.285470 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-7a5abc1a-6c8b-4be9-8cc2-e9c625fade9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:16.314107 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-7a5abc1a-6c8b-4be9-8cc2-e9c625fade9e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments/f656edcc-a6c7-4f4d-9241-77623853344f" status: 200 len: 194 microversion: 2.1 time: 0.041999 Nov 23 04:26:16.315469 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 629/1199] 10.222.0.54 () {58 vars in 1412 bytes} [Tue Nov 23 04:26:16 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments/f656edcc-a6c7-4f4d-9241-77623853344f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:16.324597 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-cc587fde-4c55-4ace-b8cb-d196e6bc255c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:16.325099 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-cc587fde-4c55-4ace-b8cb-d196e6bc255c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:16.331568 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc587fde-4c55-4ace-b8cb-d196e6bc255c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:16.332022 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc587fde-4c55-4ace-b8cb-d196e6bc255c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:16.332804 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc587fde-4c55-4ace-b8cb-d196e6bc255c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:16.333246 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc587fde-4c55-4ace-b8cb-d196e6bc255c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:16.410875 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-cc587fde-4c55-4ace-b8cb-d196e6bc255c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lazy-loading 'services' on Instance uuid 47d615b0-693e-47d1-932a-7dfc14f285bb {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:26:16.637608 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-cc587fde-4c55-4ace-b8cb-d196e6bc255c tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "DELETE /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments/f656edcc-a6c7-4f4d-9241-77623853344f" status: 202 len: 0 microversion: 2.1 time: 0.316532 Nov 23 04:26:16.638219 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 571/1200] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:26:16 2021] DELETE /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments/f656edcc-a6c7-4f4d-9241-77623853344f => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:26:18.790482 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1939d8c7-96ad-4d90-9f0f-49a0a528635b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:18.790963 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1939d8c7-96ad-4d90-9f0f-49a0a528635b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:18.797161 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1939d8c7-96ad-4d90-9f0f-49a0a528635b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:18.797627 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1939d8c7-96ad-4d90-9f0f-49a0a528635b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:18.798384 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1939d8c7-96ad-4d90-9f0f-49a0a528635b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:18.798816 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1939d8c7-96ad-4d90-9f0f-49a0a528635b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:18.826741 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1939d8c7-96ad-4d90-9f0f-49a0a528635b tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments/575fbddf-994c-4fa8-bca0-7dcac28e27c0" status: 200 len: 194 microversion: 2.1 time: 0.040045 Nov 23 04:26:18.827324 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 630/1201] 10.222.0.54 () {58 vars in 1412 bytes} [Tue Nov 23 04:26:18 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments/575fbddf-994c-4fa8-bca0-7dcac28e27c0 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:18.838729 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c6254624-72d7-4ec5-9dea-c10bd97ddb70 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:18.839419 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c6254624-72d7-4ec5-9dea-c10bd97ddb70 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:18.845501 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c6254624-72d7-4ec5-9dea-c10bd97ddb70 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:18.846113 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c6254624-72d7-4ec5-9dea-c10bd97ddb70 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:18.847007 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c6254624-72d7-4ec5-9dea-c10bd97ddb70 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:18.847482 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c6254624-72d7-4ec5-9dea-c10bd97ddb70 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:18.925345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-c6254624-72d7-4ec5-9dea-c10bd97ddb70 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lazy-loading 'services' on Instance uuid 47d615b0-693e-47d1-932a-7dfc14f285bb {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:26:19.118072 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c6254624-72d7-4ec5-9dea-c10bd97ddb70 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "DELETE /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments/575fbddf-994c-4fa8-bca0-7dcac28e27c0" status: 202 len: 0 microversion: 2.1 time: 0.283641 Nov 23 04:26:19.118709 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 572/1202] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:26:18 2021] DELETE /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments/575fbddf-994c-4fa8-bca0-7dcac28e27c0 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:26:20.267791 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-837f543c-a408-4bb2-a65b-0099b5d15aa7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:20.268909 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-837f543c-a408-4bb2-a65b-0099b5d15aa7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:20.275402 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-837f543c-a408-4bb2-a65b-0099b5d15aa7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:20.275855 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-837f543c-a408-4bb2-a65b-0099b5d15aa7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:20.276640 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-837f543c-a408-4bb2-a65b-0099b5d15aa7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:20.277077 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-837f543c-a408-4bb2-a65b-0099b5d15aa7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:20.307265 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-837f543c-a408-4bb2-a65b-0099b5d15aa7 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043175 Nov 23 04:26:20.307817 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 631/1203] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:26:20 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:26:20.411545 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-21673061-1510-476f-977d-e17f43f1298e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:20.412585 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-21673061-1510-476f-977d-e17f43f1298e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:20.418556 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21673061-1510-476f-977d-e17f43f1298e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:20.419007 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21673061-1510-476f-977d-e17f43f1298e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:20.419806 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21673061-1510-476f-977d-e17f43f1298e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:20.420240 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21673061-1510-476f-977d-e17f43f1298e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:20.448443 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-21673061-1510-476f-977d-e17f43f1298e tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042039 Nov 23 04:26:20.448947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 573/1204] 10.222.0.54 () {58 vars in 1301 bytes} [Tue Nov 23 04:26:20 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 23 04:26:20.504064 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9de44689-7a8c-4fdc-8e66-8716eb2250b3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:20.504566 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9de44689-7a8c-4fdc-8e66-8716eb2250b3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:20.510329 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9de44689-7a8c-4fdc-8e66-8716eb2250b3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:20.510774 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9de44689-7a8c-4fdc-8e66-8716eb2250b3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:20.511574 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9de44689-7a8c-4fdc-8e66-8716eb2250b3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:20.512007 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-9de44689-7a8c-4fdc-8e66-8716eb2250b3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:20.536775 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-9de44689-7a8c-4fdc-8e66-8716eb2250b3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:26:20.753657 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9de44689-7a8c-4fdc-8e66-8716eb2250b3 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "DELETE /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 204 len: 0 microversion: 2.1 time: 0.253635 Nov 23 04:26:20.758406 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 632/1205] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:26:20 2021] DELETE /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:26:20.762109 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8cd91992-31ed-4dfd-97e6-74c51958b3ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:20.762717 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8cd91992-31ed-4dfd-97e6-74c51958b3ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:20.768562 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8cd91992-31ed-4dfd-97e6-74c51958b3ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:20.769012 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8cd91992-31ed-4dfd-97e6-74c51958b3ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:20.769798 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8cd91992-31ed-4dfd-97e6-74c51958b3ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:20.770235 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8cd91992-31ed-4dfd-97e6-74c51958b3ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:20.900599 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8cd91992-31ed-4dfd-97e6-74c51958b3ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:26:20.908063 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8cd91992-31ed-4dfd-97e6-74c51958b3ca tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1673 microversion: 2.1 time: 0.149620 Nov 23 04:26:20.909268 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 574/1206] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:26:20 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:26:21.926163 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-54292488-0d53-40d6-92f5-549e126013b0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:21.926854 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-54292488-0d53-40d6-92f5-549e126013b0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:21.933874 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-54292488-0d53-40d6-92f5-549e126013b0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:21.934441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-54292488-0d53-40d6-92f5-549e126013b0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:21.935117 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-54292488-0d53-40d6-92f5-549e126013b0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:21.935589 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-54292488-0d53-40d6-92f5-549e126013b0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:22.071310 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-54292488-0d53-40d6-92f5-549e126013b0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:26:22.078653 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-54292488-0d53-40d6-92f5-549e126013b0 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1673 microversion: 2.1 time: 0.156619 Nov 23 04:26:22.079199 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 633/1207] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:26:21 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 23 04:26:23.095525 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-71a9a49c-50a8-41fa-8804-dcd533b25d94 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:23.096900 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-71a9a49c-50a8-41fa-8804-dcd533b25d94 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:23.103267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-71a9a49c-50a8-41fa-8804-dcd533b25d94 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:23.103690 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-71a9a49c-50a8-41fa-8804-dcd533b25d94 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:23.104472 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-71a9a49c-50a8-41fa-8804-dcd533b25d94 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:23.104910 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-71a9a49c-50a8-41fa-8804-dcd533b25d94 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:23.318406 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-71a9a49c-50a8-41fa-8804-dcd533b25d94 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:26:23.325994 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-71a9a49c-50a8-41fa-8804-dcd533b25d94 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1673 microversion: 2.1 time: 0.234202 Nov 23 04:26:23.326573 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 575/1208] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:26:23 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1673 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:26:23.963033 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-c1a84c5c-1eb6-4e03-997e-d2df8215b1f6 req-739843cd-bc3a-402e-a865-770b3168deed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d615b0-693e-47d1-932a-7dfc14f285bb", "name": "network-vif-deleted", "tag": "a7c27a4c-3412-4b38-ad6e-7fd5f0d99fb9"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:26:23.964676 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:26:23.964676 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:26:23.972749 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-c1a84c5c-1eb6-4e03-997e-d2df8215b1f6 req-739843cd-bc3a-402e-a865-770b3168deed service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:23.973172 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-c1a84c5c-1eb6-4e03-997e-d2df8215b1f6 req-739843cd-bc3a-402e-a865-770b3168deed service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:23.983960 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-c1a84c5c-1eb6-4e03-997e-d2df8215b1f6 req-739843cd-bc3a-402e-a865-770b3168deed service nova] Creating event network-vif-deleted:a7c27a4c-3412-4b38-ad6e-7fd5f0d99fb9 for instance 47d615b0-693e-47d1-932a-7dfc14f285bb on hv-cinder-76845 Nov 23 04:26:23.989848 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-c1a84c5c-1eb6-4e03-997e-d2df8215b1f6 req-739843cd-bc3a-402e-a865-770b3168deed service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030354 Nov 23 04:26:23.990373 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 634/1209] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:26:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:24.343294 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:24.343848 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:24.351299 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:24.351768 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:24.352545 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:24.352974 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:24.386590 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:24.387065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:24.387545 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lazy-loading 'fault' on Instance uuid 47d615b0-693e-47d1-932a-7dfc14f285bb {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:26:24.427898 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8923a30e7b4b6b9b3c2eef472c2117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6fa4f03d864e43be8dc7eec4c89213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:26:24.435258 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9b8d2edb-ee6f-4b39-9b81-87773fa6b951 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 200 len: 1327 microversion: 2.1 time: 0.096046 Nov 23 04:26:24.435823 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 576/1210] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:26:24 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:26:25.452655 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b592c5c3-8dff-4bb6-9cf8-031ac2a8f155 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:25.453351 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b592c5c3-8dff-4bb6-9cf8-031ac2a8f155 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:25.459903 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b592c5c3-8dff-4bb6-9cf8-031ac2a8f155 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:25.460347 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b592c5c3-8dff-4bb6-9cf8-031ac2a8f155 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:25.461121 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b592c5c3-8dff-4bb6-9cf8-031ac2a8f155 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:25.461556 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b592c5c3-8dff-4bb6-9cf8-031ac2a8f155 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:25.475639 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-b592c5c3-8dff-4bb6-9cf8-031ac2a8f155 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] HTTP exception thrown: Instance 47d615b0-693e-47d1-932a-7dfc14f285bb could not be found. Nov 23 04:26:25.476221 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b592c5c3-8dff-4bb6-9cf8-031ac2a8f155 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Returning 404 to user: Instance 47d615b0-693e-47d1-932a-7dfc14f285bb could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:26:25.477028 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b592c5c3-8dff-4bb6-9cf8-031ac2a8f155 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 404 len: 111 microversion: 2.1 time: 0.028441 Nov 23 04:26:25.477567 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 635/1211] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:26:25 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:26:25.485526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-4bda09d4-93c3-45e1-81cd-619c7c6d3371 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '.version_select at 0x7fa7de193430>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:25.564514 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-4bda09d4-93c3-45e1-81cd-619c7c6d3371 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902574859" status: 202 len: 0 microversion: 2.1 time: 0.082489 Nov 23 04:26:25.565101 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 577/1212] 10.222.0.54 () {58 vars in 1220 bytes} [Tue Nov 23 04:26:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902574859 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:26:28.793939 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-11cbcc14-9042-4f86-bdee-4a354bf288cc tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:28.794531 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-11cbcc14-9042-4f86-bdee-4a354bf288cc tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:28.800899 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-11cbcc14-9042-4f86-bdee-4a354bf288cc tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:28.801338 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-11cbcc14-9042-4f86-bdee-4a354bf288cc tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:28.802111 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-11cbcc14-9042-4f86-bdee-4a354bf288cc tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:28.802540 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-11cbcc14-9042-4f86-bdee-4a354bf288cc tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:28.815435 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-11cbcc14-9042-4f86-bdee-4a354bf288cc tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] HTTP exception thrown: Instance 47d615b0-693e-47d1-932a-7dfc14f285bb could not be found. Nov 23 04:26:28.816011 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-11cbcc14-9042-4f86-bdee-4a354bf288cc tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Returning 404 to user: Instance 47d615b0-693e-47d1-932a-7dfc14f285bb could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:26:28.816808 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-11cbcc14-9042-4f86-bdee-4a354bf288cc tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "DELETE /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 404 len: 111 microversion: 2.1 time: 0.026556 Nov 23 04:26:28.817322 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 636/1213] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:26:28 2021] DELETE /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:26:28.825493 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-932c4e34-68fd-479d-9c26-ad5f8552b6cf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:28.826115 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-932c4e34-68fd-479d-9c26-ad5f8552b6cf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 47d615b0-693e-47d1-932a-7dfc14f285bb] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:28.833653 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-932c4e34-68fd-479d-9c26-ad5f8552b6cf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:28.834110 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-932c4e34-68fd-479d-9c26-ad5f8552b6cf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:28.834897 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-932c4e34-68fd-479d-9c26-ad5f8552b6cf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:28.835368 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-932c4e34-68fd-479d-9c26-ad5f8552b6cf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:28.848809 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-932c4e34-68fd-479d-9c26-ad5f8552b6cf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] HTTP exception thrown: Instance 47d615b0-693e-47d1-932a-7dfc14f285bb could not be found. Nov 23 04:26:28.849417 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-932c4e34-68fd-479d-9c26-ad5f8552b6cf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Returning 404 to user: Instance 47d615b0-693e-47d1-932a-7dfc14f285bb could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:26:28.850240 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-932c4e34-68fd-479d-9c26-ad5f8552b6cf tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb" status: 404 len: 111 microversion: 2.1 time: 0.029004 Nov 23 04:26:28.850774 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 578/1214] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:26:28 2021] GET /compute/v2.1/servers/47d615b0-693e-47d1-932a-7dfc14f285bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:26:30.086986 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0d75cf23-6899-4630-9d47-91fc47d6ffbd tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:30.087540 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0d75cf23-6899-4630-9d47-91fc47d6ffbd tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:30.093716 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0d75cf23-6899-4630-9d47-91fc47d6ffbd tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:30.094163 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0d75cf23-6899-4630-9d47-91fc47d6ffbd tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:30.094929 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0d75cf23-6899-4630-9d47-91fc47d6ffbd tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:30.095398 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0d75cf23-6899-4630-9d47-91fc47d6ffbd tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:30.108606 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-0d75cf23-6899-4630-9d47-91fc47d6ffbd tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] HTTP exception thrown: Instance 50329b3a-4863-4a29-92f9-e05c525f1435 could not be found. Nov 23 04:26:30.109159 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0d75cf23-6899-4630-9d47-91fc47d6ffbd tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Returning 404 to user: Instance 50329b3a-4863-4a29-92f9-e05c525f1435 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:26:30.109953 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0d75cf23-6899-4630-9d47-91fc47d6ffbd tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "DELETE /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 404 len: 111 microversion: 2.1 time: 0.026695 Nov 23 04:26:30.110466 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 637/1215] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:26:30 2021] DELETE /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:26:30.118692 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8208511b-bd08-4074-8637-c306e8b84620 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:30.119352 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8208511b-bd08-4074-8637-c306e8b84620 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] [instance: 50329b3a-4863-4a29-92f9-e05c525f1435] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:26:30.125523 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8208511b-bd08-4074-8637-c306e8b84620 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:30.125974 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8208511b-bd08-4074-8637-c306e8b84620 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:30.126750 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8208511b-bd08-4074-8637-c306e8b84620 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:26:30.127189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8208511b-bd08-4074-8637-c306e8b84620 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:26:30.140005 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-8208511b-bd08-4074-8637-c306e8b84620 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] HTTP exception thrown: Instance 50329b3a-4863-4a29-92f9-e05c525f1435 could not be found. Nov 23 04:26:30.140592 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8208511b-bd08-4074-8637-c306e8b84620 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] Returning 404 to user: Instance 50329b3a-4863-4a29-92f9-e05c525f1435 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:26:30.141416 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8208511b-bd08-4074-8637-c306e8b84620 tempest-AttachVolumeTestJSON-1215713605 tempest-AttachVolumeTestJSON-1215713605-project] 10.222.0.54 "GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435" status: 404 len: 111 microversion: 2.1 time: 0.026440 Nov 23 04:26:30.141959 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 579/1216] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:26:30 2021] GET /compute/v2.1/servers/50329b3a-4863-4a29-92f9-e05c525f1435 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:26:35.905275 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c8657132-26ad-4083-9525-969102c739eb tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Action: 'create', calling method: .version_select at 0x7fa7dd7549d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-731489770"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:26:36.546449 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c8657132-26ad-4083-9525-969102c739eb tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.765770 Nov 23 04:26:36.547089 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 638/1217] 10.222.0.54 () {60 vars in 1154 bytes} [Tue Nov 23 04:26:35 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 767 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 23 04:26:36.558173 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-15f5a24b-2082-4975-86e3-22b167d66703 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7de193f70>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:36.605669 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-15f5a24b-2082-4975-86e3-22b167d66703 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9" status: 200 len: 344 microversion: 2.1 time: 0.051004 Nov 23 04:26:36.606244 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 580/1218] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:26:36 2021] GET /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:37.618349 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bc9a7c42-3afa-4645-9916-b84717f71455 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dd78e940>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:37.665824 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bc9a7c42-3afa-4645-9916-b84717f71455 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9" status: 200 len: 345 microversion: 2.1 time: 0.051696 Nov 23 04:26:37.666384 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 639/1219] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:26:37 2021] GET /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:37.678175 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-9fe83659-3cad-4f64-a6e1-7e0f15bc88b4 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Action: 'create', calling method: .version_select at 0x7fa7dddcca60>, body: {"snapshot": {"volume_id": "d41e2bd3-6874-4c66-91f5-b8ba34c09ce9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-309011339"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:26:38.085067 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-9fe83659-3cad-4f64-a6e1-7e0f15bc88b4 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.411554 Nov 23 04:26:38.085649 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 581/1220] 10.222.0.54 () {60 vars in 1161 bytes} [Tue Nov 23 04:26:37 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:38.095527 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d09ac5ed-34ce-47fc-a798-bf67cdf73a0b tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dd78edc0>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:38.123717 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d09ac5ed-34ce-47fc-a798-bf67cdf73a0b tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431" status: 200 len: 286 microversion: 2.1 time: 0.031929 Nov 23 04:26:38.124288 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 640/1221] 10.222.0.54 () {58 vars in 1250 bytes} [Tue Nov 23 04:26:38 2021] GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:38.134274 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3e956d87-2b77-452b-99ab-12f997a91807 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dddcc5e0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:38.180943 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3e956d87-2b77-452b-99ab-12f997a91807 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.044249 Nov 23 04:26:38.180943 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 582/1222] 10.222.0.54 () {58 vars in 1139 bytes} [Tue Nov 23 04:26:38 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:38.185778 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e43d8366-a746-4bb9-b117-42adfd6ebdd4 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dd81cee0>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:38.214568 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e43d8366-a746-4bb9-b117-42adfd6ebdd4 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431" status: 200 len: 286 microversion: 2.1 time: 0.032646 Nov 23 04:26:38.215149 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 641/1223] 10.222.0.54 () {58 vars in 1250 bytes} [Tue Nov 23 04:26:38 2021] GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:39.226918 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-80c8b986-130d-4139-b220-eca54c8762e7 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7ddddaaf0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:39.255431 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-80c8b986-130d-4139-b220-eca54c8762e7 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431" status: 200 len: 286 microversion: 2.1 time: 0.033037 Nov 23 04:26:39.256134 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 583/1224] 10.222.0.54 () {58 vars in 1250 bytes} [Tue Nov 23 04:26:39 2021] GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:26:40.266975 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-9a83c6b8-f70e-447b-b75a-e4cc8b96677b tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dd7d4820>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:40.296476 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-9a83c6b8-f70e-447b-b75a-e4cc8b96677b tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431" status: 200 len: 286 microversion: 2.1 time: 0.033699 Nov 23 04:26:40.297059 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 642/1225] 10.222.0.54 () {58 vars in 1250 bytes} [Tue Nov 23 04:26:40 2021] GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:41.308546 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-18d0dcfd-d7ff-41b5-b170-03f6c7fd1dc8 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7de2a4dc0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:41.337715 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-18d0dcfd-d7ff-41b5-b170-03f6c7fd1dc8 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431" status: 200 len: 286 microversion: 2.1 time: 0.033247 Nov 23 04:26:41.338267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 584/1226] 10.222.0.54 () {58 vars in 1250 bytes} [Tue Nov 23 04:26:41 2021] GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:42.349648 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-07cbe628-f420-4a05-b141-a3df3b63b118 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dd81c9d0>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:42.377532 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-07cbe628-f420-4a05-b141-a3df3b63b118 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431" status: 200 len: 287 microversion: 2.1 time: 0.032048 Nov 23 04:26:42.378076 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 643/1227] 10.222.0.54 () {58 vars in 1250 bytes} [Tue Nov 23 04:26:42 2021] GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:42.388815 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-de902dad-057b-46d2-a5f5-d23c1989b476 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dde929d0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:42.477983 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-de902dad-057b-46d2-a5f5-d23c1989b476 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "DELETE /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431" status: 202 len: 0 microversion: 2.1 time: 0.093102 Nov 23 04:26:42.478597 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 585/1228] 10.222.0.54 () {58 vars in 1253 bytes} [Tue Nov 23 04:26:42 2021] DELETE /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:26:42.487095 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3ff8be81-4eb2-4913-8043-aa1eccc8ca77 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dd6859d0>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:42.515723 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3ff8be81-4eb2-4913-8043-aa1eccc8ca77 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431" status: 200 len: 286 microversion: 2.1 time: 0.032361 Nov 23 04:26:42.516263 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 644/1229] 10.222.0.54 () {58 vars in 1250 bytes} [Tue Nov 23 04:26:42 2021] GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:43.527549 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5f9270ac-9a99-4b37-9c30-e2b0bc6b2ebb tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7de193c10>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:43.550756 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-5f9270ac-9a99-4b37-9c30-e2b0bc6b2ebb tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] HTTP exception thrown: Snapshot a22dadd4-6a8b-4b71-91b5-a3862de09431 could not be found. Nov 23 04:26:43.551385 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-5f9270ac-9a99-4b37-9c30-e2b0bc6b2ebb tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Returning 404 to user: Snapshot a22dadd4-6a8b-4b71-91b5-a3862de09431 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:26:43.552711 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-5f9270ac-9a99-4b37-9c30-e2b0bc6b2ebb tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431" status: 404 len: 111 microversion: 2.1 time: 0.029356 Nov 23 04:26:43.553208 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 586/1230] 10.222.0.54 () {58 vars in 1250 bytes} [Tue Nov 23 04:26:43 2021] GET /compute/v2.1/os-snapshots/a22dadd4-6a8b-4b71-91b5-a3862de09431 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:26:43.561383 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-686cb949-3819-43e5-a33c-fd8b8d0f7b66 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dd7cb0d0>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:43.733885 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-686cb949-3819-43e5-a33c-fd8b8d0f7b66 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "DELETE /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9" status: 202 len: 0 microversion: 2.1 time: 0.176447 Nov 23 04:26:43.734433 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 645/1231] 10.222.0.54 () {58 vars in 1247 bytes} [Tue Nov 23 04:26:43 2021] DELETE /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:26:43.743571 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-38ca95c5-5c64-40b9-924e-83943cf68428 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dde4b0d0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:43.788641 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-38ca95c5-5c64-40b9-924e-83943cf68428 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9" status: 200 len: 344 microversion: 2.1 time: 0.049324 Nov 23 04:26:43.791335 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 587/1232] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:26:43 2021] GET /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:26:44.800890 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ffea1285-037c-4c49-9dcd-8e52a64c0429 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dd78ea60>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:44.826516 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-ffea1285-037c-4c49-9dcd-8e52a64c0429 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] HTTP exception thrown: Volume d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 could not be found. Nov 23 04:26:44.827098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ffea1285-037c-4c49-9dcd-8e52a64c0429 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Returning 404 to user: Volume d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:26:44.827936 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ffea1285-037c-4c49-9dcd-8e52a64c0429 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9" status: 404 len: 109 microversion: 2.1 time: 0.031188 Nov 23 04:26:44.828494 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 646/1233] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:26:44 2021] GET /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:26:44.843228 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-deac036d-5b73-4e40-b3c4-00ff69ecb01d tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7de2d3af0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:44.870464 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-deac036d-5b73-4e40-b3c4-00ff69ecb01d tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] HTTP exception thrown: Volume d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 could not be found. Nov 23 04:26:44.871065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-deac036d-5b73-4e40-b3c4-00ff69ecb01d tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Returning 404 to user: Volume d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:26:44.871919 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-deac036d-5b73-4e40-b3c4-00ff69ecb01d tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "DELETE /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9" status: 404 len: 109 microversion: 2.1 time: 0.032908 Nov 23 04:26:44.872450 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 588/1234] 10.222.0.54 () {58 vars in 1247 bytes} [Tue Nov 23 04:26:44 2021] DELETE /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:26:44.879951 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-27b98d70-535f-4646-b09f-1e8283ce7c83 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Calling method '.version_select at 0x7fa7dd754790>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:26:44.909448 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-27b98d70-535f-4646-b09f-1e8283ce7c83 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] HTTP exception thrown: Volume d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 could not be found. Nov 23 04:26:44.910036 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-27b98d70-535f-4646-b09f-1e8283ce7c83 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] Returning 404 to user: Volume d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:26:44.910853 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-27b98d70-535f-4646-b09f-1e8283ce7c83 tempest-VolumesSnapshotsTestJSON-1733209359 tempest-VolumesSnapshotsTestJSON-1733209359-project] 10.222.0.54 "GET /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9" status: 404 len: 109 microversion: 2.1 time: 0.034486 Nov 23 04:26:44.911401 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 647/1235] 10.222.0.54 () {58 vars in 1244 bytes} [Tue Nov 23 04:26:44 2021] GET /compute/v2.1/os-volumes/d41e2bd3-6874-4c66-91f5-b8ba34c09ce9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:27:09.064198 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b821ade7-0e17-4696-b8e9-dd8883333ca4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:09.064741 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b821ade7-0e17-4696-b8e9-dd8883333ca4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:09.065305 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-47bf1fd8-ffbb-45cd-a2c7-d90115775d41 req-cb2655cf-3024-4238-b6aa-186a8491d0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9", "tag": "6cdf2244-83da-4def-a6ac-139f11920457"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:27:09.067000 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:27:09.067000 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:27:09.071190 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b821ade7-0e17-4696-b8e9-dd8883333ca4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:09.072245 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b821ade7-0e17-4696-b8e9-dd8883333ca4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:09.072956 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b821ade7-0e17-4696-b8e9-dd8883333ca4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:09.073394 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b821ade7-0e17-4696-b8e9-dd8883333ca4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:09.076138 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-47bf1fd8-ffbb-45cd-a2c7-d90115775d41 req-cb2655cf-3024-4238-b6aa-186a8491d0e4 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:09.076641 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-47bf1fd8-ffbb-45cd-a2c7-d90115775d41 req-cb2655cf-3024-4238-b6aa-186a8491d0e4 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:09.087690 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-47bf1fd8-ffbb-45cd-a2c7-d90115775d41 req-cb2655cf-3024-4238-b6aa-186a8491d0e4 service nova] Creating event network-changed:6cdf2244-83da-4def-a6ac-139f11920457 for instance 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 on hv-cinder-76845 Nov 23 04:27:09.093151 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-47bf1fd8-ffbb-45cd-a2c7-d90115775d41 req-cb2655cf-3024-4238-b6aa-186a8491d0e4 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031352 Nov 23 04:27:09.093816 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 648/1236] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:27:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:27:09.100054 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b821ade7-0e17-4696-b8e9-dd8883333ca4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Going to try to terminate instance {{(pid=116837) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:27:09.397251 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b821ade7-0e17-4696-b8e9-dd8883333ca4 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "DELETE /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 204 len: 0 microversion: 2.1 time: 0.338363 Nov 23 04:27:09.398038 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 589/1237] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:27:09 2021] DELETE /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:27:09.406591 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-71fa3d5f-4246-4488-8820-cdd75b22e3b3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:09.411793 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-71fa3d5f-4246-4488-8820-cdd75b22e3b3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:09.414234 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-71fa3d5f-4246-4488-8820-cdd75b22e3b3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:09.414680 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-71fa3d5f-4246-4488-8820-cdd75b22e3b3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:09.415714 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-71fa3d5f-4246-4488-8820-cdd75b22e3b3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:09.416238 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-71fa3d5f-4246-4488-8820-cdd75b22e3b3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:09.638301 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-71fa3d5f-4246-4488-8820-cdd75b22e3b3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:09.647844 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-71fa3d5f-4246-4488-8820-cdd75b22e3b3 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1576 microversion: 2.1 time: 0.245347 Nov 23 04:27:09.648726 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 649/1238] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:09 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:10.666825 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-034b6443-3a9e-49c1-943e-f428411f7d20 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:10.667559 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-034b6443-3a9e-49c1-943e-f428411f7d20 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:10.673870 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-034b6443-3a9e-49c1-943e-f428411f7d20 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:10.674322 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-034b6443-3a9e-49c1-943e-f428411f7d20 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:10.678924 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-034b6443-3a9e-49c1-943e-f428411f7d20 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:10.678924 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-034b6443-3a9e-49c1-943e-f428411f7d20 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:10.808232 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-034b6443-3a9e-49c1-943e-f428411f7d20 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:10.815522 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-034b6443-3a9e-49c1-943e-f428411f7d20 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1458 microversion: 2.1 time: 0.153331 Nov 23 04:27:10.816088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 590/1239] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:10 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1458 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:11.836724 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-689675e9-398c-4fbe-ae07-6633b97a6d1d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:11.836724 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-689675e9-398c-4fbe-ae07-6633b97a6d1d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:11.841694 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-689675e9-398c-4fbe-ae07-6633b97a6d1d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:11.842143 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-689675e9-398c-4fbe-ae07-6633b97a6d1d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:11.842969 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-689675e9-398c-4fbe-ae07-6633b97a6d1d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:11.843428 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-689675e9-398c-4fbe-ae07-6633b97a6d1d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:12.041328 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-c65b254c-b641-4166-b2da-38b9eabb1ccb req-2314c20b-74e3-4156-8bf3-02c9cc97866a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9", "name": "network-vif-deleted", "tag": "6cdf2244-83da-4def-a6ac-139f11920457"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:27:12.043302 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:27:12.043302 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:27:12.047989 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-689675e9-398c-4fbe-ae07-6633b97a6d1d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:12.050417 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-c65b254c-b641-4166-b2da-38b9eabb1ccb req-2314c20b-74e3-4156-8bf3-02c9cc97866a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:12.050869 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-c65b254c-b641-4166-b2da-38b9eabb1ccb req-2314c20b-74e3-4156-8bf3-02c9cc97866a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:12.055413 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-689675e9-398c-4fbe-ae07-6633b97a6d1d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1458 microversion: 2.1 time: 0.225132 Nov 23 04:27:12.056785 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 650/1240] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:11 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1458 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:12.063791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-c65b254c-b641-4166-b2da-38b9eabb1ccb req-2314c20b-74e3-4156-8bf3-02c9cc97866a service nova] Creating event network-vif-deleted:6cdf2244-83da-4def-a6ac-139f11920457 for instance 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 on hv-cinder-76845 Nov 23 04:27:12.068615 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-c65b254c-b641-4166-b2da-38b9eabb1ccb req-2314c20b-74e3-4156-8bf3-02c9cc97866a service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030985 Nov 23 04:27:12.069234 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 591/1241] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:27:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:27:13.137993 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:13.137993 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:13.137993 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:13.137993 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:13.139516 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:13.139516 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:13.139516 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:13.139516 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:13.139815 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lazy-loading 'fault' on Instance uuid 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:27:13.156203 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:13.163414 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2422e141-d98d-4167-b286-c16c688b6382 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 200 len: 1229 microversion: 2.1 time: 0.093715 Nov 23 04:27:13.163981 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 651/1242] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:13 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:14.182821 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d24122f6-22c1-43ac-996c-cee9baa1ff88 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:14.183505 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d24122f6-22c1-43ac-996c-cee9baa1ff88 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:14.189539 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d24122f6-22c1-43ac-996c-cee9baa1ff88 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:14.193539 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d24122f6-22c1-43ac-996c-cee9baa1ff88 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:14.193539 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d24122f6-22c1-43ac-996c-cee9baa1ff88 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:14.193539 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d24122f6-22c1-43ac-996c-cee9baa1ff88 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:14.204477 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-d24122f6-22c1-43ac-996c-cee9baa1ff88 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] HTTP exception thrown: Instance 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 could not be found. Nov 23 04:27:14.205121 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d24122f6-22c1-43ac-996c-cee9baa1ff88 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Returning 404 to user: Instance 1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:27:14.206038 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d24122f6-22c1-43ac-996c-cee9baa1ff88 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9" status: 404 len: 111 microversion: 2.1 time: 0.028520 Nov 23 04:27:14.206564 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 592/1243] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:14 2021] GET /compute/v2.1/servers/1e2f090d-9aa2-4e6b-bea9-1fbf12c282c9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:27:20.876578 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-17b81298-793f-49f4-90b5-d03660fae1fb tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:20.877079 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-17b81298-793f-49f4-90b5-d03660fae1fb tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:20.884636 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-17b81298-793f-49f4-90b5-d03660fae1fb tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:20.885197 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-17b81298-793f-49f4-90b5-d03660fae1fb tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:20.886049 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-17b81298-793f-49f4-90b5-d03660fae1fb tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:20.886561 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-17b81298-793f-49f4-90b5-d03660fae1fb tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:20.914782 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-17b81298-793f-49f4-90b5-d03660fae1fb tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:27:21.011978 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-7802d15e-5fb2-45fb-aea8-3459f9666cdb req-324e794d-e527-4a7b-90f1-a38dfc36d04e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3425df3-cde6-44d8-8c24-3221f5cd3053", "tag": "f0d43386-0513-4341-9b99-404d03b12ec0"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:27:21.017777 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:27:21.017777 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:27:21.020210 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-7802d15e-5fb2-45fb-aea8-3459f9666cdb req-324e794d-e527-4a7b-90f1-a38dfc36d04e service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:21.020660 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-7802d15e-5fb2-45fb-aea8-3459f9666cdb req-324e794d-e527-4a7b-90f1-a38dfc36d04e service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:21.032862 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-7802d15e-5fb2-45fb-aea8-3459f9666cdb req-324e794d-e527-4a7b-90f1-a38dfc36d04e service nova] Creating event network-changed:f0d43386-0513-4341-9b99-404d03b12ec0 for instance e3425df3-cde6-44d8-8c24-3221f5cd3053 on hv-cinder-76845 Nov 23 04:27:21.037938 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-7802d15e-5fb2-45fb-aea8-3459f9666cdb req-324e794d-e527-4a7b-90f1-a38dfc36d04e service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163046 Nov 23 04:27:21.038894 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 593/1244] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:27:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:27:21.306618 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-17b81298-793f-49f4-90b5-d03660fae1fb tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "DELETE /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 204 len: 0 microversion: 2.1 time: 0.432863 Nov 23 04:27:21.307753 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 652/1245] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:27:20 2021] DELETE /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:27:21.316186 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-cc34e7a7-6073-4396-92dd-0d6c2e83369a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:21.317088 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-cc34e7a7-6073-4396-92dd-0d6c2e83369a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:21.324036 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc34e7a7-6073-4396-92dd-0d6c2e83369a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:21.324591 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc34e7a7-6073-4396-92dd-0d6c2e83369a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:21.325506 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc34e7a7-6073-4396-92dd-0d6c2e83369a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:21.325945 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-cc34e7a7-6073-4396-92dd-0d6c2e83369a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:21.549007 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-cc34e7a7-6073-4396-92dd-0d6c2e83369a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:21.558391 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-cc34e7a7-6073-4396-92dd-0d6c2e83369a tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1578 microversion: 2.1 time: 0.246092 Nov 23 04:27:21.559051 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 594/1246] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:21 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1578 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:22.576663 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-1a4ab752-6668-4b59-bf13-c147bc04ca7c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:22.577349 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-1a4ab752-6668-4b59-bf13-c147bc04ca7c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:22.583563 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a4ab752-6668-4b59-bf13-c147bc04ca7c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:22.584013 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a4ab752-6668-4b59-bf13-c147bc04ca7c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:22.584799 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a4ab752-6668-4b59-bf13-c147bc04ca7c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:22.585232 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-1a4ab752-6668-4b59-bf13-c147bc04ca7c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:22.717777 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-1a4ab752-6668-4b59-bf13-c147bc04ca7c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:22.725037 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-1a4ab752-6668-4b59-bf13-c147bc04ca7c tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1459 microversion: 2.1 time: 0.152483 Nov 23 04:27:22.725596 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 653/1247] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:22 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1459 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:23.742475 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-a3faec0d-7abe-41e5-9d88-ade7871cbf91 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:23.743786 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-a3faec0d-7abe-41e5-9d88-ade7871cbf91 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:23.749967 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a3faec0d-7abe-41e5-9d88-ade7871cbf91 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:23.750418 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a3faec0d-7abe-41e5-9d88-ade7871cbf91 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:23.751195 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a3faec0d-7abe-41e5-9d88-ade7871cbf91 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:23.751659 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-a3faec0d-7abe-41e5-9d88-ade7871cbf91 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:23.881034 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-a3faec0d-7abe-41e5-9d88-ade7871cbf91 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:23.888388 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-a3faec0d-7abe-41e5-9d88-ade7871cbf91 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1459 microversion: 2.1 time: 0.149559 Nov 23 04:27:23.888950 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 595/1248] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:23 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1459 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:24.905754 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-c2a2fc93-82ea-4c88-8430-abaff5e1c9b0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:24.906366 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-c2a2fc93-82ea-4c88-8430-abaff5e1c9b0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:24.912691 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c2a2fc93-82ea-4c88-8430-abaff5e1c9b0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:24.913137 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c2a2fc93-82ea-4c88-8430-abaff5e1c9b0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:24.913911 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c2a2fc93-82ea-4c88-8430-abaff5e1c9b0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:24.914346 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-c2a2fc93-82ea-4c88-8430-abaff5e1c9b0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:25.050256 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-c2a2fc93-82ea-4c88-8430-abaff5e1c9b0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:25.058415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-c2a2fc93-82ea-4c88-8430-abaff5e1c9b0 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1459 microversion: 2.1 time: 0.156705 Nov 23 04:27:25.058977 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 654/1249] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:24 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:26.077553 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-0746d7a5-40f3-427c-ab88-54f7e220c746 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:26.078157 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-0746d7a5-40f3-427c-ab88-54f7e220c746 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:26.084790 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0746d7a5-40f3-427c-ab88-54f7e220c746 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:26.085235 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0746d7a5-40f3-427c-ab88-54f7e220c746 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:26.086003 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0746d7a5-40f3-427c-ab88-54f7e220c746 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:26.087066 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-0746d7a5-40f3-427c-ab88-54f7e220c746 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:26.173101 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-0746d7a5-40f3-427c-ab88-54f7e220c746 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:26.181801 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-0746d7a5-40f3-427c-ab88-54f7e220c746 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1392 microversion: 2.1 time: 0.109439 Nov 23 04:27:26.182626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 596/1250] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:26 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1392 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:26.234752 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-d017515a-6d48-4a20-aa0e-f9af6df4329a req-20e81460-f8e1-4146-a1cf-9c87f26ea9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3425df3-cde6-44d8-8c24-3221f5cd3053", "name": "network-vif-deleted", "tag": "f0d43386-0513-4341-9b99-404d03b12ec0"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:27:26.234752 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:27:26.234752 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:27:26.241653 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-d017515a-6d48-4a20-aa0e-f9af6df4329a req-20e81460-f8e1-4146-a1cf-9c87f26ea9de service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:26.242092 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-d017515a-6d48-4a20-aa0e-f9af6df4329a req-20e81460-f8e1-4146-a1cf-9c87f26ea9de service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:26.253097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-d017515a-6d48-4a20-aa0e-f9af6df4329a req-20e81460-f8e1-4146-a1cf-9c87f26ea9de service nova] Creating event network-vif-deleted:f0d43386-0513-4341-9b99-404d03b12ec0 for instance e3425df3-cde6-44d8-8c24-3221f5cd3053 on hv-cinder-76845 Nov 23 04:27:26.259662 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-d017515a-6d48-4a20-aa0e-f9af6df4329a req-20e81460-f8e1-4146-a1cf-9c87f26ea9de service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030018 Nov 23 04:27:26.260289 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 655/1251] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:27:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:27:27.198851 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:27.199506 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:27.205778 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:27.206230 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:27.207014 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:27.207482 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:27.239300 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:27.239754 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:27.240215 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lazy-loading 'fault' on Instance uuid e3425df3-cde6-44d8-8c24-3221f5cd3053 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:27:27.280152 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e3605d1b0045e48d5836380ce77dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8068470657b040ab9af34219d8935846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:27.287998 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-3129efd6-69cf-4c5c-8fc6-f81f232ff181 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 200 len: 1230 microversion: 2.1 time: 0.092769 Nov 23 04:27:27.290969 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 597/1252] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:27 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:28.306703 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-167dda9a-6719-41cd-9bf2-a95b8b544318 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:28.307426 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-167dda9a-6719-41cd-9bf2-a95b8b544318 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: e3425df3-cde6-44d8-8c24-3221f5cd3053] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:28.313829 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-167dda9a-6719-41cd-9bf2-a95b8b544318 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:28.314278 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-167dda9a-6719-41cd-9bf2-a95b8b544318 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:28.315056 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-167dda9a-6719-41cd-9bf2-a95b8b544318 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:28.315514 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-167dda9a-6719-41cd-9bf2-a95b8b544318 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:28.328103 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-167dda9a-6719-41cd-9bf2-a95b8b544318 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] HTTP exception thrown: Instance e3425df3-cde6-44d8-8c24-3221f5cd3053 could not be found. Nov 23 04:27:28.328686 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-167dda9a-6719-41cd-9bf2-a95b8b544318 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Returning 404 to user: Instance e3425df3-cde6-44d8-8c24-3221f5cd3053 could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:27:28.329489 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-167dda9a-6719-41cd-9bf2-a95b8b544318 tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053" status: 404 len: 111 microversion: 2.1 time: 0.027582 Nov 23 04:27:28.330011 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 656/1253] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:28 2021] GET /compute/v2.1/servers/e3425df3-cde6-44d8-8c24-3221f5cd3053 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:27:28.953350 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6b1b06cc-abe1-45b3-9128-0d1e59cc005d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:28.955658 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6b1b06cc-abe1-45b3-9128-0d1e59cc005d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:28.960217 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b1b06cc-abe1-45b3-9128-0d1e59cc005d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:28.960795 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b1b06cc-abe1-45b3-9128-0d1e59cc005d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:28.962255 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b1b06cc-abe1-45b3-9128-0d1e59cc005d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:28.962701 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b1b06cc-abe1-45b3-9128-0d1e59cc005d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:28.975667 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-6b1b06cc-abe1-45b3-9128-0d1e59cc005d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] HTTP exception thrown: Instance 94641710-5efb-41aa-acde-03bacf08f49e could not be found. Nov 23 04:27:28.976242 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6b1b06cc-abe1-45b3-9128-0d1e59cc005d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Returning 404 to user: Instance 94641710-5efb-41aa-acde-03bacf08f49e could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:27:28.977156 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6b1b06cc-abe1-45b3-9128-0d1e59cc005d tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "DELETE /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 404 len: 111 microversion: 2.1 time: 0.027480 Nov 23 04:27:28.977895 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 598/1254] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:27:28 2021] DELETE /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:27:28.985695 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-688e239a-5332-4b9a-84fe-6c36e086d97f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:28.986309 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-688e239a-5332-4b9a-84fe-6c36e086d97f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] [instance: 94641710-5efb-41aa-acde-03bacf08f49e] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:28.992143 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-688e239a-5332-4b9a-84fe-6c36e086d97f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:28.993173 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-688e239a-5332-4b9a-84fe-6c36e086d97f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:28.993741 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-688e239a-5332-4b9a-84fe-6c36e086d97f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:28.994248 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-688e239a-5332-4b9a-84fe-6c36e086d97f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:29.010153 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-688e239a-5332-4b9a-84fe-6c36e086d97f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] HTTP exception thrown: Instance 94641710-5efb-41aa-acde-03bacf08f49e could not be found. Nov 23 04:27:29.010740 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-688e239a-5332-4b9a-84fe-6c36e086d97f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Returning 404 to user: Instance 94641710-5efb-41aa-acde-03bacf08f49e could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:27:29.011590 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-688e239a-5332-4b9a-84fe-6c36e086d97f tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e" status: 404 len: 111 microversion: 2.1 time: 0.029580 Nov 23 04:27:29.012134 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 657/1255] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:28 2021] GET /compute/v2.1/servers/94641710-5efb-41aa-acde-03bacf08f49e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:27:30.528918 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-cfc180cd-cce9-4475-9ff5-860a751ab9de tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] Calling method '.version_select at 0x7fa7de111af0>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:30.604527 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-cfc180cd-cce9-4475-9ff5-860a751ab9de tempest-TestVolumeBootPattern-1129268142 tempest-TestVolumeBootPattern-1129268142-project] 10.222.0.54 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673532001" status: 202 len: 0 microversion: 2.1 time: 0.080284 Nov 23 04:27:30.605136 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 599/1256] 10.222.0.54 () {58 vars in 1259 bytes} [Tue Nov 23 04:27:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-673532001 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 23 04:27:37.091080 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-178915765", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "networks": [{"uuid": "4aa2a4b8-a939-485a-bd14-88158a650324"}]}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:27:37.145515 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.network.neutron [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] validate_networks() for [('4aa2a4b8-a939-485a-bd14-88158a650324', None, None, None, None, None)] {{(pid=116836) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:27:37.550088 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Flavor limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:27:37.550506 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Image limits 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:27:37.551006 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Flavor pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:27:37.551466 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Image pref 0:0:0 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:27:37.551859 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.virt.hardware [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:27:37.560976 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:37.561415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:37.562216 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:37.562642 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:37.578129 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Getting quotas for project 5aefaed1a2c141bf8363bb8ad5676b30. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:27:37.581942 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.quota [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Getting quotas for user 24fc924af9d5451e90d31896b61074b6 and project 5aefaed1a2c141bf8363bb8ad5676b30. Resources: {'instances', 'ram', 'cores'} {{(pid=116836) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:27:37.592879 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Going to run 1 instances... {{(pid=116836) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:27:37.595162 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:27:37.708562 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [1e3f73f6-40de-496e-bb67-0e880065d01f] AMQP server on 10.222.0.54:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 23 04:27:38.725876 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO oslo.messaging._drivers.impl_rabbit [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [1e3f73f6-40de-496e-bb67-0e880065d01f] Reconnected to AMQP server on 10.222.0.54:5672 via [amqp] client with port 53466. Nov 23 04:27:38.741344 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0e14cf09-4584-4ed0-a994-367f24ead194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.653887 Nov 23 04:27:38.742232 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 658/1257] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:27:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:27:38.763697 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c7849dfb-e7e3-4528-b12e-e4018788deae tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:38.763697 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c7849dfb-e7e3-4528-b12e-e4018788deae tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:38.809839 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c7849dfb-e7e3-4528-b12e-e4018788deae tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:38.816339 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c7849dfb-e7e3-4528-b12e-e4018788deae tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1218 microversion: 2.1 time: 0.066914 Nov 23 04:27:38.816906 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 600/1258] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:38 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:39.834042 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-57356954-09d9-478d-b7b9-e25a76aae832 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:39.834635 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-57356954-09d9-478d-b7b9-e25a76aae832 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:39.885534 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-57356954-09d9-478d-b7b9-e25a76aae832 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:39.892126 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-57356954-09d9-478d-b7b9-e25a76aae832 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1218 microversion: 2.1 time: 0.062752 Nov 23 04:27:39.892677 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 659/1259] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:39 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:40.909045 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c0a36273-bba1-4e92-8292-0c436594283d tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:40.909658 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c0a36273-bba1-4e92-8292-0c436594283d tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:40.915974 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c0a36273-bba1-4e92-8292-0c436594283d tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:40.916423 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c0a36273-bba1-4e92-8292-0c436594283d tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:40.917201 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c0a36273-bba1-4e92-8292-0c436594283d tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:40.917636 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c0a36273-bba1-4e92-8292-0c436594283d tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:40.978061 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c0a36273-bba1-4e92-8292-0c436594283d tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:40.985317 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c0a36273-bba1-4e92-8292-0c436594283d tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1222 microversion: 2.1 time: 0.079977 Nov 23 04:27:40.985874 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 601/1260] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:40 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:42.001898 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-03b8b3ea-3207-40e2-a412-810d5f48580c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:42.002515 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-03b8b3ea-3207-40e2-a412-810d5f48580c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:42.008864 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-03b8b3ea-3207-40e2-a412-810d5f48580c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:42.009318 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-03b8b3ea-3207-40e2-a412-810d5f48580c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:42.010098 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-03b8b3ea-3207-40e2-a412-810d5f48580c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:42.010615 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-03b8b3ea-3207-40e2-a412-810d5f48580c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:42.070190 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-03b8b3ea-3207-40e2-a412-810d5f48580c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:42.077460 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-03b8b3ea-3207-40e2-a412-810d5f48580c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1270 microversion: 2.1 time: 0.079221 Nov 23 04:27:42.078018 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 660/1261] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:41 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1270 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:43.094309 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-25081868-3f24-474a-b2ef-58fdb56890f8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:43.094916 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-25081868-3f24-474a-b2ef-58fdb56890f8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:43.100760 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-25081868-3f24-474a-b2ef-58fdb56890f8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:43.101201 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-25081868-3f24-474a-b2ef-58fdb56890f8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:43.101978 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-25081868-3f24-474a-b2ef-58fdb56890f8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:43.102393 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-25081868-3f24-474a-b2ef-58fdb56890f8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:43.558015 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-25081868-3f24-474a-b2ef-58fdb56890f8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:43.565338 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-25081868-3f24-474a-b2ef-58fdb56890f8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1318 microversion: 2.1 time: 0.475366 Nov 23 04:27:43.565934 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 602/1262] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:43 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:44.187531 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-4eef5737-3c74-4789-a9d1-2e16f18c295e req-7bea004b-9550-46b6-a2e5-b977c48d0fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ac26d8f-892c-459a-a3fb-699050981b6a", "tag": "f0e5b778-1834-4698-960a-708288f788dd"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:27:44.189180 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:27:44.189180 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:27:44.196818 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-4eef5737-3c74-4789-a9d1-2e16f18c295e req-7bea004b-9550-46b6-a2e5-b977c48d0fca service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:44.197261 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-4eef5737-3c74-4789-a9d1-2e16f18c295e req-7bea004b-9550-46b6-a2e5-b977c48d0fca service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:44.208964 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-4eef5737-3c74-4789-a9d1-2e16f18c295e req-7bea004b-9550-46b6-a2e5-b977c48d0fca service nova] Creating event network-changed:f0e5b778-1834-4698-960a-708288f788dd for instance 2ac26d8f-892c-459a-a3fb-699050981b6a on hv-cinder-76845 Nov 23 04:27:44.213830 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-4eef5737-3c74-4789-a9d1-2e16f18c295e req-7bea004b-9550-46b6-a2e5-b977c48d0fca service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031125 Nov 23 04:27:44.216381 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 661/1263] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:27:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:27:44.581813 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-91198720-5cc6-44c8-b864-de8f71b4635f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:44.582454 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-91198720-5cc6-44c8-b864-de8f71b4635f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:44.588799 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-91198720-5cc6-44c8-b864-de8f71b4635f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:44.589256 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-91198720-5cc6-44c8-b864-de8f71b4635f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:44.590488 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-91198720-5cc6-44c8-b864-de8f71b4635f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:44.590667 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-91198720-5cc6-44c8-b864-de8f71b4635f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:44.848188 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-91198720-5cc6-44c8-b864-de8f71b4635f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:44.855893 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-91198720-5cc6-44c8-b864-de8f71b4635f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1318 microversion: 2.1 time: 0.277318 Nov 23 04:27:44.856533 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 603/1264] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:44 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:45.802935 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:27:45.803482 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: Tue Nov 23 04:27:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 04:27:45.873240 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-646d7a53-8309-457a-9b30-86b8a4969946 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:45.873930 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-646d7a53-8309-457a-9b30-86b8a4969946 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:45.880429 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-646d7a53-8309-457a-9b30-86b8a4969946 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:45.880911 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-646d7a53-8309-457a-9b30-86b8a4969946 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:45.881681 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-646d7a53-8309-457a-9b30-86b8a4969946 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:45.882107 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-646d7a53-8309-457a-9b30-86b8a4969946 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:46.012113 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-646d7a53-8309-457a-9b30-86b8a4969946 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:46.019176 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-646d7a53-8309-457a-9b30-86b8a4969946 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1318 microversion: 2.1 time: 0.150373 Nov 23 04:27:46.019757 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 662/1265] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:45 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:47.036245 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-8aef25db-f8f9-4ca2-8697-cec4aa6a0e74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:47.036852 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-8aef25db-f8f9-4ca2-8697-cec4aa6a0e74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:47.043583 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8aef25db-f8f9-4ca2-8697-cec4aa6a0e74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:47.044022 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8aef25db-f8f9-4ca2-8697-cec4aa6a0e74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:47.044784 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8aef25db-f8f9-4ca2-8697-cec4aa6a0e74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:47.045222 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-8aef25db-f8f9-4ca2-8697-cec4aa6a0e74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:47.177806 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-8aef25db-f8f9-4ca2-8697-cec4aa6a0e74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:47.185656 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-8aef25db-f8f9-4ca2-8697-cec4aa6a0e74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1318 microversion: 2.1 time: 0.153047 Nov 23 04:27:47.186215 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 604/1266] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:47 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:48.201651 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-b3142a0b-7a17-4112-a153-24d02173af57 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:48.202441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-b3142a0b-7a17-4112-a153-24d02173af57 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:48.208845 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b3142a0b-7a17-4112-a153-24d02173af57 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:48.209287 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b3142a0b-7a17-4112-a153-24d02173af57 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:48.210060 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b3142a0b-7a17-4112-a153-24d02173af57 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:48.210491 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-b3142a0b-7a17-4112-a153-24d02173af57 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:48.338518 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-b3142a0b-7a17-4112-a153-24d02173af57 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:48.346322 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-b3142a0b-7a17-4112-a153-24d02173af57 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1318 microversion: 2.1 time: 0.148438 Nov 23 04:27:48.346880 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 663/1267] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:48 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:49.362998 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-773ca5a1-5e81-4cc3-92a9-026e2dbfaf33 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:49.363783 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-773ca5a1-5e81-4cc3-92a9-026e2dbfaf33 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:49.370047 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-773ca5a1-5e81-4cc3-92a9-026e2dbfaf33 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:49.370521 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-773ca5a1-5e81-4cc3-92a9-026e2dbfaf33 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:49.377157 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-773ca5a1-5e81-4cc3-92a9-026e2dbfaf33 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:49.377157 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-773ca5a1-5e81-4cc3-92a9-026e2dbfaf33 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:49.503314 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-773ca5a1-5e81-4cc3-92a9-026e2dbfaf33 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:49.513684 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-773ca5a1-5e81-4cc3-92a9-026e2dbfaf33 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1318 microversion: 2.1 time: 0.154425 Nov 23 04:27:49.514268 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 605/1268] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:49 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:49.547068 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-7c9c5138-aa37-4184-bafa-1398ab2d8fcb req-6a2fc025-0d55-464f-b4cd-aacec23972e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac26d8f-892c-459a-a3fb-699050981b6a", "name": "network-vif-plugged", "status": "completed", "tag": "f0e5b778-1834-4698-960a-708288f788dd"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:27:49.554771 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:27:49.554771 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:27:49.556138 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-7c9c5138-aa37-4184-bafa-1398ab2d8fcb req-6a2fc025-0d55-464f-b4cd-aacec23972e3 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:49.556580 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-7c9c5138-aa37-4184-bafa-1398ab2d8fcb req-6a2fc025-0d55-464f-b4cd-aacec23972e3 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:49.567297 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-7c9c5138-aa37-4184-bafa-1398ab2d8fcb req-6a2fc025-0d55-464f-b4cd-aacec23972e3 service nova] Creating event network-vif-plugged:f0e5b778-1834-4698-960a-708288f788dd for instance 2ac26d8f-892c-459a-a3fb-699050981b6a on hv-cinder-76845 Nov 23 04:27:49.572494 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-7c9c5138-aa37-4184-bafa-1398ab2d8fcb req-6a2fc025-0d55-464f-b4cd-aacec23972e3 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029509 Nov 23 04:27:49.573025 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 664/1269] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:27:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:27:50.530842 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-7759b559-030b-42a0-a40e-b43563cddaf5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:50.531467 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-7759b559-030b-42a0-a40e-b43563cddaf5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:50.537768 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7759b559-030b-42a0-a40e-b43563cddaf5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:50.538210 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7759b559-030b-42a0-a40e-b43563cddaf5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:50.538989 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7759b559-030b-42a0-a40e-b43563cddaf5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:50.539449 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-7759b559-030b-42a0-a40e-b43563cddaf5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:50.667131 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-7759b559-030b-42a0-a40e-b43563cddaf5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:50.675025 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-7759b559-030b-42a0-a40e-b43563cddaf5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1318 microversion: 2.1 time: 0.148990 Nov 23 04:27:50.675627 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 606/1270] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:50 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:27:51.693757 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-dd04fe9c-4092-4a10-8cea-d4ade22a5ae6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:27:51.694446 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-dd04fe9c-4092-4a10-8cea-d4ade22a5ae6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:27:51.700500 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dd04fe9c-4092-4a10-8cea-d4ade22a5ae6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:51.700944 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dd04fe9c-4092-4a10-8cea-d4ade22a5ae6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:51.701711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dd04fe9c-4092-4a10-8cea-d4ade22a5ae6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:27:51.702134 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-dd04fe9c-4092-4a10-8cea-d4ade22a5ae6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:27:51.835837 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-dd04fe9c-4092-4a10-8cea-d4ade22a5ae6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:27:51.842965 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-dd04fe9c-4092-4a10-8cea-d4ade22a5ae6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1507 microversion: 2.1 time: 0.153653 Nov 23 04:27:51.843576 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 665/1271] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:27:51 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:08.233353 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6b7c389e-52fc-41ca-bcbf-585a0957379c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "742762ed-6880-4a1a-81a5-6c72a87b44d4", "device": "/dev/sdb"}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:28:08.235055 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6b7c389e-52fc-41ca-bcbf-585a0957379c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:08.243294 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b7c389e-52fc-41ca-bcbf-585a0957379c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:08.243294 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b7c389e-52fc-41ca-bcbf-585a0957379c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:08.243294 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b7c389e-52fc-41ca-bcbf-585a0957379c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:08.243294 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6b7c389e-52fc-41ca-bcbf-585a0957379c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:08.978124 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6b7c389e-52fc-41ca-bcbf-585a0957379c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "POST /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.748369 Nov 23 04:28:08.978834 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 607/1272] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:28:08 2021] POST /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a/os-volume_attachments => generated 194 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:28:33.394829 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-0dd97b89-bc34-4661-a404-a3df5d090cf7 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:33.395437 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-0dd97b89-bc34-4661-a404-a3df5d090cf7 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:33.401731 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0dd97b89-bc34-4661-a404-a3df5d090cf7 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:33.402176 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0dd97b89-bc34-4661-a404-a3df5d090cf7 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:33.402960 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0dd97b89-bc34-4661-a404-a3df5d090cf7 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:33.403431 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-0dd97b89-bc34-4661-a404-a3df5d090cf7 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:33.482548 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.objects.instance [None req-0dd97b89-bc34-4661-a404-a3df5d090cf7 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lazy-loading 'services' on Instance uuid 2ac26d8f-892c-459a-a3fb-699050981b6a {{(pid=116836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:28:33.719767 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-0dd97b89-bc34-4661-a404-a3df5d090cf7 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "DELETE /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a/os-volume_attachments/742762ed-6880-4a1a-81a5-6c72a87b44d4" status: 202 len: 0 microversion: 2.1 time: 0.328660 Nov 23 04:28:33.720550 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 666/1273] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:28:33 2021] DELETE /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a/os-volume_attachments/742762ed-6880-4a1a-81a5-6c72a87b44d4 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:28:34.831651 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-b4107759-cc6f-4ca8-955e-5cc8ad84d194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:34.832219 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b4107759-cc6f-4ca8-955e-5cc8ad84d194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:34.838880 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b4107759-cc6f-4ca8-955e-5cc8ad84d194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:34.839371 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b4107759-cc6f-4ca8-955e-5cc8ad84d194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:34.840158 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b4107759-cc6f-4ca8-955e-5cc8ad84d194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:34.840596 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-b4107759-cc6f-4ca8-955e-5cc8ad84d194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:34.865689 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-b4107759-cc6f-4ca8-955e-5cc8ad84d194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Going to try to terminate instance {{(pid=116837) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:28:35.121933 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-b4107759-cc6f-4ca8-955e-5cc8ad84d194 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "DELETE /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 204 len: 0 microversion: 2.1 time: 0.294512 Nov 23 04:28:35.122526 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 608/1274] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:28:34 2021] DELETE /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:28:35.132624 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-d37ced39-fbde-497d-b7f0-5b701e3999c6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:35.133326 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-d37ced39-fbde-497d-b7f0-5b701e3999c6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:35.139455 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d37ced39-fbde-497d-b7f0-5b701e3999c6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:35.139908 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d37ced39-fbde-497d-b7f0-5b701e3999c6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:35.140680 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d37ced39-fbde-497d-b7f0-5b701e3999c6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:35.141114 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-d37ced39-fbde-497d-b7f0-5b701e3999c6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:35.276352 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-d37ced39-fbde-497d-b7f0-5b701e3999c6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:35.283793 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-d37ced39-fbde-497d-b7f0-5b701e3999c6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1513 microversion: 2.1 time: 0.156804 Nov 23 04:28:35.284420 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 667/1275] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:35 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:36.301613 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-653c8cf2-a78e-4f3c-9124-7c28e90e4844 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:36.302256 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-653c8cf2-a78e-4f3c-9124-7c28e90e4844 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:36.308626 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-653c8cf2-a78e-4f3c-9124-7c28e90e4844 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:36.309076 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-653c8cf2-a78e-4f3c-9124-7c28e90e4844 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:36.309855 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-653c8cf2-a78e-4f3c-9124-7c28e90e4844 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:36.310287 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-653c8cf2-a78e-4f3c-9124-7c28e90e4844 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:36.440227 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-653c8cf2-a78e-4f3c-9124-7c28e90e4844 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:36.448050 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-653c8cf2-a78e-4f3c-9124-7c28e90e4844 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1513 microversion: 2.1 time: 0.150612 Nov 23 04:28:36.448611 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 609/1276] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:36 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:37.401536 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-3a7eae87-03e4-4bde-9c87-258434670925 req-a38ab96e-651f-48ae-a35d-a960b4255a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac26d8f-892c-459a-a3fb-699050981b6a", "name": "network-vif-deleted", "tag": "f0e5b778-1834-4698-960a-708288f788dd"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:28:37.404390 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:28:37.404390 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:28:37.410730 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-3a7eae87-03e4-4bde-9c87-258434670925 req-a38ab96e-651f-48ae-a35d-a960b4255a03 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:37.411259 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-3a7eae87-03e4-4bde-9c87-258434670925 req-a38ab96e-651f-48ae-a35d-a960b4255a03 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:37.422445 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-3a7eae87-03e4-4bde-9c87-258434670925 req-a38ab96e-651f-48ae-a35d-a960b4255a03 service nova] Creating event network-vif-deleted:f0e5b778-1834-4698-960a-708288f788dd for instance 2ac26d8f-892c-459a-a3fb-699050981b6a on hv-cinder-76845 Nov 23 04:28:37.427519 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-3a7eae87-03e4-4bde-9c87-258434670925 req-a38ab96e-651f-48ae-a35d-a960b4255a03 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030129 Nov 23 04:28:37.431166 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 668/1277] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:28:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:28:37.464585 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-99d393fc-df58-45ec-a112-bee30a826574 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:37.465227 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-99d393fc-df58-45ec-a112-bee30a826574 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:37.471605 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d393fc-df58-45ec-a112-bee30a826574 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:37.472070 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d393fc-df58-45ec-a112-bee30a826574 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:37.472855 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d393fc-df58-45ec-a112-bee30a826574 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:37.473315 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-99d393fc-df58-45ec-a112-bee30a826574 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:37.535417 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-99d393fc-df58-45ec-a112-bee30a826574 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:37.543477 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-99d393fc-df58-45ec-a112-bee30a826574 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 200 len: 1471 microversion: 2.1 time: 0.082651 Nov 23 04:28:37.544052 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 610/1278] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:37 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:38.562056 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-483b117a-bc7b-40b1-8727-8f653781b117 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:38.563023 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-483b117a-bc7b-40b1-8727-8f653781b117 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: 2ac26d8f-892c-459a-a3fb-699050981b6a] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:38.569976 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-483b117a-bc7b-40b1-8727-8f653781b117 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:38.570415 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-483b117a-bc7b-40b1-8727-8f653781b117 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:38.571201 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-483b117a-bc7b-40b1-8727-8f653781b117 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:38.571650 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-483b117a-bc7b-40b1-8727-8f653781b117 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:38.584822 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.wsgi [None req-483b117a-bc7b-40b1-8727-8f653781b117 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] HTTP exception thrown: Instance 2ac26d8f-892c-459a-a3fb-699050981b6a could not be found. Nov 23 04:28:38.585396 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-483b117a-bc7b-40b1-8727-8f653781b117 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Returning 404 to user: Instance 2ac26d8f-892c-459a-a3fb-699050981b6a could not be found. {{(pid=116836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:28:38.586190 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-483b117a-bc7b-40b1-8727-8f653781b117 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a" status: 404 len: 111 microversion: 2.1 time: 0.028205 Nov 23 04:28:38.586699 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 669/1279] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:38 2021] GET /compute/v2.1/servers/2ac26d8f-892c-459a-a3fb-699050981b6a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:28:48.872791 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-295636812", "imageRef": "82bd78be-966d-4404-b042-b4c730d21eae", "flavorRef": "452", "networks": [{"uuid": "4aa2a4b8-a939-485a-bd14-88158a650324"}]}} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:28:48.923688 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.network.neutron [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] validate_networks() for [('4aa2a4b8-a939-485a-bd14-88158a650324', None, None, None, None, None)] {{(pid=116837) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 23 04:28:49.358593 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Flavor limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 23 04:28:49.359021 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Image limits 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 23 04:28:49.359517 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Flavor pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 23 04:28:49.359931 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Image pref 0:0:0 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 23 04:28:49.360337 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.virt.hardware [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 23 04:28:49.369598 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:49.370048 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:49.370855 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:49.371322 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:49.387623 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Getting quotas for project 5aefaed1a2c141bf8363bb8ad5676b30. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 23 04:28:49.391421 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.quota [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Getting quotas for user 24fc924af9d5451e90d31896b61074b6 and project 5aefaed1a2c141bf8363bb8ad5676b30. Resources: {'instances', 'ram', 'cores'} {{(pid=116837) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 23 04:28:49.402806 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Going to run 1 instances... {{(pid=116837) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 23 04:28:49.405113 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='82bd78be-966d-4404-b042-b4c730d21eae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 23 04:28:49.559366 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-346db042-3bbc-4410-b060-458a0a365b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690049 Nov 23 04:28:49.560012 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 611/1280] 10.222.0.54 () {60 vars in 1146 bytes} [Tue Nov 23 04:28:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 23 04:28:49.569837 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-f766e99c-affe-4967-97bc-2c465612f40e tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:49.570860 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-f766e99c-affe-4967-97bc-2c465612f40e tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:49.626242 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-f766e99c-affe-4967-97bc-2c465612f40e tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:49.632983 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-f766e99c-affe-4967-97bc-2c465612f40e tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1218 microversion: 2.1 time: 0.066961 Nov 23 04:28:49.633543 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 670/1281] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:49 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:50.649898 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-f8dce993-305a-48a1-9b34-6fa806d0f005 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:50.650469 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-f8dce993-305a-48a1-9b34-6fa806d0f005 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:50.657189 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f8dce993-305a-48a1-9b34-6fa806d0f005 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:50.657632 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f8dce993-305a-48a1-9b34-6fa806d0f005 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:50.658432 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f8dce993-305a-48a1-9b34-6fa806d0f005 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:50.658865 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-f8dce993-305a-48a1-9b34-6fa806d0f005 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:50.721403 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-f8dce993-305a-48a1-9b34-6fa806d0f005 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:50.729437 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-f8dce993-305a-48a1-9b34-6fa806d0f005 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1222 microversion: 2.1 time: 0.083402 Nov 23 04:28:50.730010 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 612/1282] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:50 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:51.747422 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-34c4d77d-5da1-4cb3-b1e9-99698cf73fc8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:51.748191 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-34c4d77d-5da1-4cb3-b1e9-99698cf73fc8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:51.755989 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-34c4d77d-5da1-4cb3-b1e9-99698cf73fc8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:51.756437 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-34c4d77d-5da1-4cb3-b1e9-99698cf73fc8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:51.757306 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-34c4d77d-5da1-4cb3-b1e9-99698cf73fc8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:51.757841 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-34c4d77d-5da1-4cb3-b1e9-99698cf73fc8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:51.837658 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-34c4d77d-5da1-4cb3-b1e9-99698cf73fc8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:51.845104 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-34c4d77d-5da1-4cb3-b1e9-99698cf73fc8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1276 microversion: 2.1 time: 0.103098 Nov 23 04:28:51.845673 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 671/1283] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:51 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:52.867106 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-c9777ea2-0cc3-4533-b8bd-3fb10c143191 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:52.867967 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-c9777ea2-0cc3-4533-b8bd-3fb10c143191 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:52.874522 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c9777ea2-0cc3-4533-b8bd-3fb10c143191 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:52.874974 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c9777ea2-0cc3-4533-b8bd-3fb10c143191 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:52.875778 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c9777ea2-0cc3-4533-b8bd-3fb10c143191 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:52.876260 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-c9777ea2-0cc3-4533-b8bd-3fb10c143191 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:53.039461 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-c9777ea2-0cc3-4533-b8bd-3fb10c143191 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:53.047129 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-c9777ea2-0cc3-4533-b8bd-3fb10c143191 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1318 microversion: 2.1 time: 0.184253 Nov 23 04:28:53.047740 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 613/1284] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:52 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:53.060122 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [req-3692966f-9868-4c47-9573-be84e56d0a30 req-113ac6e8-2e30-47aa-b2fb-40a6e871ec2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c01b84-e2c5-42b6-8684-eb9a5968b8d6", "tag": "9f3576f3-7583-4f6c-a484-51013e5d7c69"}]} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:28:53.062104 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:28:53.062104 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: warnings.warn(msg) Nov 23 04:28:53.069555 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-3692966f-9868-4c47-9573-be84e56d0a30 req-113ac6e8-2e30-47aa-b2fb-40a6e871ec2b service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:53.070136 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [req-3692966f-9868-4c47-9573-be84e56d0a30 req-113ac6e8-2e30-47aa-b2fb-40a6e871ec2b service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:53.081245 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.compute.server_external_events [req-3692966f-9868-4c47-9573-be84e56d0a30 req-113ac6e8-2e30-47aa-b2fb-40a6e871ec2b service nova] Creating event network-changed:9f3576f3-7583-4f6c-a484-51013e5d7c69 for instance e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 on hv-cinder-76845 Nov 23 04:28:53.086281 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [req-3692966f-9868-4c47-9573-be84e56d0a30 req-113ac6e8-2e30-47aa-b2fb-40a6e871ec2b service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029780 Nov 23 04:28:53.086978 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 672/1285] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:28:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:28:54.065073 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d385ec91-33ea-4736-a93b-634139229add tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:54.065738 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d385ec91-33ea-4736-a93b-634139229add tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:54.072412 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d385ec91-33ea-4736-a93b-634139229add tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:54.072860 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d385ec91-33ea-4736-a93b-634139229add tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:54.073645 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d385ec91-33ea-4736-a93b-634139229add tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:54.074081 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d385ec91-33ea-4736-a93b-634139229add tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:54.202914 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d385ec91-33ea-4736-a93b-634139229add tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:54.211003 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d385ec91-33ea-4736-a93b-634139229add tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1318 microversion: 2.1 time: 0.149090 Nov 23 04:28:54.211591 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 614/1286] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:54 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:55.228711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-fc1ffd8b-8e4e-494f-9cdc-055b15ae7656 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:55.229441 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-fc1ffd8b-8e4e-494f-9cdc-055b15ae7656 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:55.235946 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc1ffd8b-8e4e-494f-9cdc-055b15ae7656 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:55.238646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc1ffd8b-8e4e-494f-9cdc-055b15ae7656 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:55.238646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc1ffd8b-8e4e-494f-9cdc-055b15ae7656 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:55.238646 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-fc1ffd8b-8e4e-494f-9cdc-055b15ae7656 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:55.374508 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-fc1ffd8b-8e4e-494f-9cdc-055b15ae7656 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:55.381861 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-fc1ffd8b-8e4e-494f-9cdc-055b15ae7656 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1318 microversion: 2.1 time: 0.157881 Nov 23 04:28:55.382984 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 673/1287] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:55 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:56.398850 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-d97a86c8-d717-4533-9d67-e2ee93bf6f74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:56.399538 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-d97a86c8-d717-4533-9d67-e2ee93bf6f74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:56.406058 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d97a86c8-d717-4533-9d67-e2ee93bf6f74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:56.406531 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d97a86c8-d717-4533-9d67-e2ee93bf6f74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:56.407345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d97a86c8-d717-4533-9d67-e2ee93bf6f74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:56.407790 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-d97a86c8-d717-4533-9d67-e2ee93bf6f74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:56.535183 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-d97a86c8-d717-4533-9d67-e2ee93bf6f74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:56.543232 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-d97a86c8-d717-4533-9d67-e2ee93bf6f74 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1318 microversion: 2.1 time: 0.148785 Nov 23 04:28:56.543807 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 615/1288] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:56 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:57.560350 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-bd1130c6-6754-4824-a54a-4bff0ed91441 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:57.560956 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-bd1130c6-6754-4824-a54a-4bff0ed91441 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:57.567115 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bd1130c6-6754-4824-a54a-4bff0ed91441 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:57.567592 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bd1130c6-6754-4824-a54a-4bff0ed91441 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:57.568361 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bd1130c6-6754-4824-a54a-4bff0ed91441 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:57.568790 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-bd1130c6-6754-4824-a54a-4bff0ed91441 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:57.705521 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-bd1130c6-6754-4824-a54a-4bff0ed91441 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:57.713035 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-bd1130c6-6754-4824-a54a-4bff0ed91441 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1318 microversion: 2.1 time: 0.156372 Nov 23 04:28:57.713598 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 674/1289] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:57 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:58.730642 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-806cdc60-2247-48a4-bc93-5c8df026cda5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:58.731333 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-806cdc60-2247-48a4-bc93-5c8df026cda5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:58.738423 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-806cdc60-2247-48a4-bc93-5c8df026cda5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:58.739328 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-806cdc60-2247-48a4-bc93-5c8df026cda5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:58.740119 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-806cdc60-2247-48a4-bc93-5c8df026cda5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:58.740560 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-806cdc60-2247-48a4-bc93-5c8df026cda5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:58.877518 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-806cdc60-2247-48a4-bc93-5c8df026cda5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:28:58.885875 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-806cdc60-2247-48a4-bc93-5c8df026cda5 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1318 microversion: 2.1 time: 0.159372 Nov 23 04:28:58.886440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 616/1290] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:58 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:28:59.902165 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-4d0b5e24-e72d-4258-8d88-198ffe5db770 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:28:59.902768 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-4d0b5e24-e72d-4258-8d88-198ffe5db770 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:28:59.909009 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d0b5e24-e72d-4258-8d88-198ffe5db770 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:59.909434 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d0b5e24-e72d-4258-8d88-198ffe5db770 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:28:59.910204 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d0b5e24-e72d-4258-8d88-198ffe5db770 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:28:59.910630 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-4d0b5e24-e72d-4258-8d88-198ffe5db770 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:00.038273 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-4d0b5e24-e72d-4258-8d88-198ffe5db770 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:29:00.045926 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-4d0b5e24-e72d-4258-8d88-198ffe5db770 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1318 microversion: 2.1 time: 0.147957 Nov 23 04:29:00.046482 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 675/1291] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:28:59 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:29:00.325982 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-18f5e58f-d618-4647-8b53-4c256868dd0f req-0d5b5fda-62f0-41e9-ac2d-b0470881ed74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c01b84-e2c5-42b6-8684-eb9a5968b8d6", "name": "network-vif-plugged", "status": "completed", "tag": "9f3576f3-7583-4f6c-a484-51013e5d7c69"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:29:00.327596 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:29:00.327596 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:29:00.334767 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-18f5e58f-d618-4647-8b53-4c256868dd0f req-0d5b5fda-62f0-41e9-ac2d-b0470881ed74 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:00.336011 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-18f5e58f-d618-4647-8b53-4c256868dd0f req-0d5b5fda-62f0-41e9-ac2d-b0470881ed74 service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:00.346613 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-18f5e58f-d618-4647-8b53-4c256868dd0f req-0d5b5fda-62f0-41e9-ac2d-b0470881ed74 service nova] Creating event network-vif-plugged:9f3576f3-7583-4f6c-a484-51013e5d7c69 for instance e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 on hv-cinder-76845 Nov 23 04:29:00.352835 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-18f5e58f-d618-4647-8b53-4c256868dd0f req-0d5b5fda-62f0-41e9-ac2d-b0470881ed74 service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030779 Nov 23 04:29:00.353522 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 617/1292] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:29:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 23 04:29:01.062831 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-ed98b30a-c2be-4c1f-b8ee-006d2befb1b8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:29:01.063458 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-ed98b30a-c2be-4c1f-b8ee-006d2befb1b8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:29:01.069878 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed98b30a-c2be-4c1f-b8ee-006d2befb1b8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:01.070326 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed98b30a-c2be-4c1f-b8ee-006d2befb1b8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:01.071119 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed98b30a-c2be-4c1f-b8ee-006d2befb1b8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:01.071561 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-ed98b30a-c2be-4c1f-b8ee-006d2befb1b8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:01.202355 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-ed98b30a-c2be-4c1f-b8ee-006d2befb1b8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:29:01.209711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-ed98b30a-c2be-4c1f-b8ee-006d2befb1b8 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1318 microversion: 2.1 time: 0.150729 Nov 23 04:29:01.210925 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 676/1293] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:29:01 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:29:02.227187 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-e3dff3c6-4f4c-4350-9d09-1a6b6679c41c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:29:02.227903 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-e3dff3c6-4f4c-4350-9d09-1a6b6679c41c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:29:02.234482 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e3dff3c6-4f4c-4350-9d09-1a6b6679c41c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:02.234939 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e3dff3c6-4f4c-4350-9d09-1a6b6679c41c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:02.235768 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e3dff3c6-4f4c-4350-9d09-1a6b6679c41c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:02.236277 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-e3dff3c6-4f4c-4350-9d09-1a6b6679c41c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:02.369156 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-e3dff3c6-4f4c-4350-9d09-1a6b6679c41c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:29:02.376744 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-e3dff3c6-4f4c-4350-9d09-1a6b6679c41c tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1506 microversion: 2.1 time: 0.153590 Nov 23 04:29:02.377329 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 618/1294] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:29:02 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:29:02.392855 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-e6e6ab87-4932-438f-a1b6-f48f6ad99d8b tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1267044-fa78-4762-99d9-108d385809e7", "device": "/dev/sdb"}} {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:29:02.398329 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-e6e6ab87-4932-438f-a1b6-f48f6ad99d8b tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:29:02.401188 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6e6ab87-4932-438f-a1b6-f48f6ad99d8b tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:02.401641 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6e6ab87-4932-438f-a1b6-f48f6ad99d8b tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:02.402432 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6e6ab87-4932-438f-a1b6-f48f6ad99d8b tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:02.402872 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-e6e6ab87-4932-438f-a1b6-f48f6ad99d8b tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:03.187859 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-e6e6ab87-4932-438f-a1b6-f48f6ad99d8b tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "POST /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798611 Nov 23 04:29:03.188457 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 677/1295] 10.222.0.54 () {60 vars in 1322 bytes} [Tue Nov 23 04:29:02 2021] POST /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6/os-volume_attachments => generated 194 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:29:23.035345 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-21ea36e8-57ee-47cd-8ab9-886a6807a87f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:29:23.035854 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-21ea36e8-57ee-47cd-8ab9-886a6807a87f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:29:23.042584 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21ea36e8-57ee-47cd-8ab9-886a6807a87f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:23.043036 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21ea36e8-57ee-47cd-8ab9-886a6807a87f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:23.043852 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21ea36e8-57ee-47cd-8ab9-886a6807a87f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:23.044297 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-21ea36e8-57ee-47cd-8ab9-886a6807a87f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:23.119238 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.objects.instance [None req-21ea36e8-57ee-47cd-8ab9-886a6807a87f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lazy-loading 'services' on Instance uuid e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 {{(pid=116837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 23 04:29:23.427445 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-21ea36e8-57ee-47cd-8ab9-886a6807a87f tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "DELETE /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6/os-volume_attachments/c1267044-fa78-4762-99d9-108d385809e7" status: 202 len: 0 microversion: 2.1 time: 0.395633 Nov 23 04:29:23.428166 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 619/1296] 10.222.0.54 () {58 vars in 1415 bytes} [Tue Nov 23 04:29:23 2021] DELETE /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6/os-volume_attachments/c1267044-fa78-4762-99d9-108d385809e7 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 23 04:29:24.535295 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-2925f7b6-dcf4-4db3-aba3-9edabd9fa6f2 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:29:24.541270 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2925f7b6-dcf4-4db3-aba3-9edabd9fa6f2 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:29:24.542727 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2925f7b6-dcf4-4db3-aba3-9edabd9fa6f2 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:24.543181 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2925f7b6-dcf4-4db3-aba3-9edabd9fa6f2 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:24.543987 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2925f7b6-dcf4-4db3-aba3-9edabd9fa6f2 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:24.544420 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-2925f7b6-dcf4-4db3-aba3-9edabd9fa6f2 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:24.569278 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-2925f7b6-dcf4-4db3-aba3-9edabd9fa6f2 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Going to try to terminate instance {{(pid=116836) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 23 04:29:24.829744 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-2925f7b6-dcf4-4db3-aba3-9edabd9fa6f2 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "DELETE /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 204 len: 0 microversion: 2.1 time: 0.298549 Nov 23 04:29:24.830324 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 678/1297] 10.222.0.54 () {58 vars in 1238 bytes} [Tue Nov 23 04:29:24 2021] DELETE /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 23 04:29:24.840193 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-6526240e-a028-4e77-9cea-b968196a9045 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:29:24.845153 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-6526240e-a028-4e77-9cea-b968196a9045 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:29:24.846984 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6526240e-a028-4e77-9cea-b968196a9045 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:24.847481 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6526240e-a028-4e77-9cea-b968196a9045 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:24.848267 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6526240e-a028-4e77-9cea-b968196a9045 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:24.848703 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-6526240e-a028-4e77-9cea-b968196a9045 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:24.978918 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.policy [None req-6526240e-a028-4e77-9cea-b968196a9045 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116837) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:29:24.986183 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-6526240e-a028-4e77-9cea-b968196a9045 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1512 microversion: 2.1 time: 0.151377 Nov 23 04:29:24.986748 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 620/1298] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:29:24 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:29:26.003573 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-3e9297e1-183e-4d30-bd8f-c0ff4289bc69 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:29:26.004270 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-3e9297e1-183e-4d30-bd8f-c0ff4289bc69 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:29:26.010668 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e9297e1-183e-4d30-bd8f-c0ff4289bc69 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:26.011118 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e9297e1-183e-4d30-bd8f-c0ff4289bc69 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:26.011930 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e9297e1-183e-4d30-bd8f-c0ff4289bc69 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:26.012365 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-3e9297e1-183e-4d30-bd8f-c0ff4289bc69 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:26.266453 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-3e9297e1-183e-4d30-bd8f-c0ff4289bc69 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:29:26.273633 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-3e9297e1-183e-4d30-bd8f-c0ff4289bc69 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1512 microversion: 2.1 time: 0.274162 Nov 23 04:29:26.274723 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 679/1299] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:29:25 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:29:27.107440 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [req-47e95e82-8d84-44f3-97a9-1a7d187b734a req-321ec949-20d5-443f-9f2e-7d10ff350b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c01b84-e2c5-42b6-8684-eb9a5968b8d6", "name": "network-vif-deleted", "tag": "9f3576f3-7583-4f6c-a484-51013e5d7c69"}]} {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 23 04:29:27.108979 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 04:29:27.108979 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: warnings.warn(msg) Nov 23 04:29:27.116566 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-47e95e82-8d84-44f3-97a9-1a7d187b734a req-321ec949-20d5-443f-9f2e-7d10ff350b8a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:27.117259 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [req-47e95e82-8d84-44f3-97a9-1a7d187b734a req-321ec949-20d5-443f-9f2e-7d10ff350b8a service nova] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:27.128548 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.compute.server_external_events [req-47e95e82-8d84-44f3-97a9-1a7d187b734a req-321ec949-20d5-443f-9f2e-7d10ff350b8a service nova] Creating event network-vif-deleted:9f3576f3-7583-4f6c-a484-51013e5d7c69 for instance e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 on hv-cinder-76845 Nov 23 04:29:27.133439 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [req-47e95e82-8d84-44f3-97a9-1a7d187b734a req-321ec949-20d5-443f-9f2e-7d10ff350b8a service nova] 10.222.0.54 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029676 Nov 23 04:29:27.134647 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 621/1300] 10.222.0.54 () {64 vars in 1317 bytes} [Tue Nov 23 04:29:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 23 04:29:27.292148 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.api.openstack.wsgi [None req-cef09998-199e-4c8f-8f1b-b49b4218efd6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:29:27.292782 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.compute.api [None req-cef09998-199e-4c8f-8f1b-b49b4218efd6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116836) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:29:27.299258 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cef09998-199e-4c8f-8f1b-b49b4218efd6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:27.299716 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cef09998-199e-4c8f-8f1b-b49b4218efd6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:27.300492 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cef09998-199e-4c8f-8f1b-b49b4218efd6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:27.300921 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG oslo_concurrency.lockutils [None req-cef09998-199e-4c8f-8f1b-b49b4218efd6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:27.365711 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: DEBUG nova.policy [None req-cef09998-199e-4c8f-8f1b-b49b4218efd6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24fc924af9d5451e90d31896b61074b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aefaed1a2c141bf8363bb8ad5676b30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116836) authorize /opt/stack/nova/nova/policy.py:199}} Nov 23 04:29:27.377809 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO nova.api.openstack.requestlog [None req-cef09998-199e-4c8f-8f1b-b49b4218efd6 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 200 len: 1303 microversion: 2.1 time: 0.090379 Nov 23 04:29:27.378388 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: [pid: 116836|app: 0|req: 680/1301] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:29:27 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 23 04:29:28.395565 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fc495967-f054-4b18-8e1f-76a5c84f7b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Calling method '>' {{(pid=116837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 23 04:29:28.396173 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.compute.api [None req-fc495967-f054-4b18-8e1f-76a5c84f7b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] [instance: e9c01b84-e2c5-42b6-8684-eb9a5968b8d6] Fetching instance by UUID {{(pid=116837) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 23 04:29:28.403095 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fc495967-f054-4b18-8e1f-76a5c84f7b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:28.403561 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fc495967-f054-4b18-8e1f-76a5c84f7b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:28.404325 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fc495967-f054-4b18-8e1f-76a5c84f7b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 23 04:29:28.404757 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG oslo_concurrency.lockutils [None req-fc495967-f054-4b18-8e1f-76a5c84f7b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Lock "f047aa68-6146-4dc8-a7df-79b907216663" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 23 04:29:28.417561 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.wsgi [None req-fc495967-f054-4b18-8e1f-76a5c84f7b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] HTTP exception thrown: Instance e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 could not be found. Nov 23 04:29:28.418135 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: DEBUG nova.api.openstack.wsgi [None req-fc495967-f054-4b18-8e1f-76a5c84f7b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] Returning 404 to user: Instance e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 could not be found. {{(pid=116837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 23 04:29:28.418947 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO nova.api.openstack.requestlog [None req-fc495967-f054-4b18-8e1f-76a5c84f7b35 tempest-VolumesSnapshotTestJSON-677643480 tempest-VolumesSnapshotTestJSON-677643480-project] 10.222.0.54 "GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6" status: 404 len: 111 microversion: 2.1 time: 0.027980 Nov 23 04:29:28.419521 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: [pid: 116837|app: 0|req: 622/1302] 10.222.0.54 () {58 vars in 1235 bytes} [Tue Nov 23 04:29:28 2021] GET /compute/v2.1/servers/e9c01b84-e2c5-42b6-8684-eb9a5968b8d6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 23 04:30:21.753065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:30:21.753721 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: Tue Nov 23 04:30:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 04:31:01.013864 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:31:01.014473 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: Tue Nov 23 04:31:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 04:31:05.820589 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:31:05.821097 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: Tue Nov 23 04:31:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 04:32:38.752749 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:32:38.753359 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: Tue Nov 23 04:32:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 04:33:41.770119 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:33:41.770663 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: Tue Nov 23 04:33:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 04:34:21.032065 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:34:21.032757 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: Tue Nov 23 04:34:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 04:34:25.838252 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:34:25.838761 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: Tue Nov 23 04:34:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 04:34:34.778487 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:34:34.779091 dv-cinder-768458-16-iscsi devstack@n-api.service[116836]: Tue Nov 23 04:34:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 23 04:34:45.304039 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 23 04:34:45.304659 dv-cinder-768458-16-iscsi devstack@n-api.service[116837]: Tue Nov 23 04:34:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!